Aug 26 16:18:53 user nova-compute[73627]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 26 16:18:56 user nova-compute[73627]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73627) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73627) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73627) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 16:18:56 user nova-compute[73627]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:18:56 user nova-compute[73627]: INFO nova.virt.driver [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 26 16:18:56 user nova-compute[73627]: INFO nova.compute.provider_config [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] Acquiring lock "singleton_lock" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] Acquired lock "singleton_lock" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] Releasing lock "singleton_lock" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] Full set of CONF: {{(pid=73627) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ******************************************************************************** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] Configuration options gathered from: {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ================================================================================ {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] allow_resize_to_same_host      = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] arq_binding_timeout            = 300 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] backdoor_port                  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] backdoor_socket                = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] block_device_allocate_retries  = 300 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] block_device_allocate_retries_interval = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cert                           = self.pem {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute_monitors               = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] config_dir                     = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] config_drive_format            = iso9660 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] config_source                  = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] console_host                   = user {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] control_exchange               = nova {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cpu_allocation_ratio           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] daemon                         = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] debug                          = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] default_access_ip_network_name = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] default_availability_zone      = nova {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] default_ephemeral_format       = ext4 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] default_green_pool_size        = 1000 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] default_schedule_zone          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] disk_allocation_ratio          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] enable_new_services            = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] enabled_ssl_apis               = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] flat_injected                  = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] force_config_drive             = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] force_raw_images               = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] graceful_shutdown_timeout      = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] heal_instance_info_cache_interval = 60 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] host                           = user {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] instance_build_timeout         = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] instance_delete_interval       = 300 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] instance_name_template         = instance-%08x {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] instance_usage_audit           = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] instance_usage_audit_period    = month {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] internal_service_availability_zone = internal {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] key                            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] live_migration_retry_count     = 30 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] log_config_append              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] log_dir                        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] log_file                       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] log_options                    = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] log_rotate_interval            = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] log_rotate_interval_type       = days {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] log_rotation_type              = none {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] long_rpc_timeout               = 1800 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] max_concurrent_builds          = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] max_concurrent_live_migrations = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] max_concurrent_snapshots       = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] max_local_block_devices        = 3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] max_logfile_count              = 30 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] max_logfile_size_mb            = 200 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] maximum_instance_delete_attempts = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] metadata_listen                = 0.0.0.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] metadata_listen_port           = 8775 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] metadata_workers               = 3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] migrate_max_retries            = -1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] mkisofs_cmd                    = genisoimage {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] my_ip                          = 10.0.0.210 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] network_allocate_retries       = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] osapi_compute_listen_port      = 8774 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] osapi_compute_unique_server_name_scope =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] osapi_compute_workers          = 3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] password_length                = 12 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] periodic_enable                = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] periodic_fuzzy_delay           = 60 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] pointer_model                  = ps2mouse {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] preallocate_images             = none {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] publish_errors                 = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] pybasedir                      = /opt/stack/nova {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ram_allocation_ratio           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] rate_limit_burst               = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] rate_limit_except_level        = CRITICAL {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] rate_limit_interval            = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] reboot_timeout                 = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] reclaim_instance_interval      = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] record                         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] reimage_timeout_per_gb         = 60 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] report_interval                = 120 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] rescue_timeout                 = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] reserved_host_cpus             = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] reserved_host_disk_mb          = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] reserved_host_memory_mb        = 512 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] reserved_huge_pages            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] resize_confirm_window          = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] resize_fs_using_block_device   = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] resume_guests_state_on_host_boot = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:56 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] rpc_response_timeout           = 60 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] run_external_periodic_tasks    = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] running_deleted_instance_action = reap {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] running_deleted_instance_timeout = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler_instance_sync_interval = 120 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] service_down_time              = 720 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] servicegroup_driver            = db {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] shelved_offload_time           = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] shelved_poll_interval          = 3600 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] shutdown_timeout               = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] source_is_ipv6                 = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ssl_only                       = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] state_path                     = /opt/stack/data/nova {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] sync_power_state_interval      = 600 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] sync_power_state_pool_size     = 1000 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] syslog_log_facility            = LOG_USER {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] tempdir                        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] timeout_nbd                    = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] transport_url                  = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] update_resources_interval      = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] use_cow_images                 = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] use_eventlog                   = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] use_journal                    = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] use_json                       = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] use_rootwrap_daemon            = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] use_stderr                     = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] use_syslog                     = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vcpu_pin_set                   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plugging_is_fatal          = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plugging_timeout           = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] virt_mkfs                      = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] volume_usage_poll_interval     = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] watch_log_file                 = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] web                            = /usr/share/spice-html5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_concurrency.disable_process_locking = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.auth_strategy              = keystone {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.compute_link_prefix        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.dhcp_domain                = novalocal {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.enable_instance_password   = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.glance_link_prefix         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.instance_list_per_project_cells = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.list_records_by_skipping_down_cells = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.local_metadata_per_cell    = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.max_limit                  = 1000 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.metadata_cache_expiration  = 15 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.neutron_default_tenant_id  = default {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.use_forwarded_for          = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.use_neutron_default_nets   = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.vendordata_dynamic_targets = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.vendordata_jsonfile_path   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.backend_argument         = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.config_prefix            = cache.oslo {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.dead_timeout             = 60.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.debug_cache_backend      = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.enable_retry_client      = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.enable_socket_keepalive  = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.enabled                  = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.expiration_time          = 600 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.hashclient_retry_attempts = 2 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.memcache_dead_retry      = 300 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.memcache_password        =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.memcache_sasl_enabled    = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.memcache_username        =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.proxies                  = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.retry_attempts           = 2 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.retry_delay              = 0.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.socket_keepalive_count   = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.socket_keepalive_idle    = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.socket_keepalive_interval = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.tls_allowed_ciphers      = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.tls_cafile               = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.tls_certfile             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.tls_enabled              = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cache.tls_keyfile              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.auth_section            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.auth_type               = password {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.cafile                  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.certfile                = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.collect_timing          = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.cross_az_attach         = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.debug                   = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.endpoint_template       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.http_retries            = 3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.insecure                = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.keyfile                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.os_region_name          = RegionOne {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.split_loggers           = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cinder.timeout                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.cpu_dedicated_set      = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.cpu_shared_set         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.image_type_exclude_list = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.resource_provider_association_refresh = 300 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.shutdown_retry_interval = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] conductor.workers              = 3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] console.allowed_origins        = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] console.ssl_ciphers            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] console.ssl_minimum_version    = default {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] consoleauth.token_ttl          = 600 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.cafile                  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.certfile                = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.collect_timing          = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.connect_retries         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.connect_retry_delay     = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.endpoint_override       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.insecure                = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.keyfile                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.max_version             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.min_version             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.region_name             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.service_name            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.service_type            = accelerator {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.split_loggers           = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.status_code_retries     = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.status_code_retry_delay = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.timeout                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] cyborg.version                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.backend               = sqlalchemy {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.connection            = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.connection_debug      = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.connection_parameters =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.connection_recycle_time = 3600 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.connection_trace      = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.db_inc_retry_interval = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.db_max_retries        = 20 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.db_max_retry_interval = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.db_retry_interval     = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.max_overflow          = 50 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.max_pool_size         = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.max_retries           = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.mysql_enable_ndb      = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.mysql_wsrep_sync_wait = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.pool_timeout          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.retry_interval        = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.slave_connection      = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] database.sqlite_synchronous    = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.backend           = sqlalchemy {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.connection        = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.connection_debug  = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.connection_parameters =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.connection_recycle_time = 3600 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.connection_trace  = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.db_inc_retry_interval = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.db_max_retries    = 20 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.db_max_retry_interval = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.db_retry_interval = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.max_overflow      = 50 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.max_pool_size     = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.max_retries       = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.mysql_enable_ndb  = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.pool_timeout      = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.retry_interval    = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.slave_connection  = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] api_database.sqlite_synchronous = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] devices.enabled_mdev_types     = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ephemeral_storage_encryption.enabled = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.api_servers             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.cafile                  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.certfile                = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.collect_timing          = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.connect_retries         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.connect_retry_delay     = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.debug                   = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.default_trusted_certificate_ids = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.enable_certificate_validation = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.enable_rbd_download     = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.endpoint_override       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.insecure                = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.keyfile                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.max_version             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.min_version             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.num_retries             = 3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.rbd_ceph_conf           =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.rbd_connect_timeout     = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.rbd_pool                =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.rbd_user                =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.region_name             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.service_name            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.service_type            = image {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.split_loggers           = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.status_code_retries     = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.status_code_retry_delay = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.timeout                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.verify_glance_signatures = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] glance.version                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] guestfs.debug                  = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.config_drive_cdrom      = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.config_drive_inject_password = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.enable_remotefx         = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.instances_path_share    =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.limit_cpu_features      = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.use_multipath_io        = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.vswitch_name            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] mks.enabled                    = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] image_cache.manager_interval   = 2400 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] image_cache.precache_concurrency = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] image_cache.remove_unused_base_images = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] image_cache.subdirectory_name  = _base {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.api_max_retries         = 60 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.api_retry_interval      = 2 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.auth_section            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.auth_type               = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.cafile                  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.certfile                = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.collect_timing          = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.connect_retries         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.connect_retry_delay     = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.endpoint_override       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.insecure                = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.keyfile                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.max_version             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.min_version             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.partition_key           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.peer_list               = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.region_name             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.serial_console_state_timeout = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.service_name            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.service_type            = baremetal {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.split_loggers           = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.status_code_retries     = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.status_code_retry_delay = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.timeout                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ironic.version                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] key_manager.fixed_key          = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.barbican_api_version  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.barbican_endpoint     = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.barbican_endpoint_type = public {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.barbican_region_name  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.cafile                = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.certfile              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.collect_timing        = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.insecure              = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.keyfile               = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.number_of_retries     = 60 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.retry_delay           = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.send_service_user_token = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.split_loggers         = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.timeout               = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.verify_ssl            = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican.verify_ssl_path       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican_service_user.auth_section = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican_service_user.auth_type = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican_service_user.cafile   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican_service_user.certfile = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican_service_user.collect_timing = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican_service_user.insecure = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican_service_user.keyfile  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican_service_user.split_loggers = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] barbican_service_user.timeout  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.approle_role_id          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.approle_secret_id        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.cafile                   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.certfile                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.collect_timing           = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.insecure                 = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.keyfile                  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.kv_mountpoint            = secret {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.kv_version               = 2 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.namespace                = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.root_token_id            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.split_loggers            = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.ssl_ca_crt_file          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.timeout                  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.use_ssl                  = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.cafile                = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.certfile              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.collect_timing        = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.connect_retries       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.connect_retry_delay   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.endpoint_override     = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.insecure              = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.keyfile               = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.max_version           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.min_version           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.region_name           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.service_name          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.service_type          = identity {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.split_loggers         = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.status_code_retries   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.status_code_retry_delay = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.timeout               = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] keystone.version               = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.connection_uri         =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.cpu_mode               = custom {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: WARNING oslo_config.cfg [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.cpu_power_governor_high = performance {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.cpu_power_management   = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.device_detach_attempts = 8 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.device_detach_timeout  = 20 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.disk_cachemodes        = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.disk_prefix            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.enabled_perf_events    = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.file_backed_memory     = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.gid_maps               = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.hw_disk_discard        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.hw_machine_type        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.images_rbd_pool        = rbd {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.images_type            = default {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.images_volume_group    = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.inject_key             = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.inject_partition       = -2 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.inject_password        = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.iscsi_iface            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.iser_use_multipath     = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_downtime = 500 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_inbound_addr = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_scheme  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_timeout_action = abort {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_tunnelled = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: WARNING oslo_config.cfg [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 26 16:18:57 user nova-compute[73627]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 26 16:18:57 user nova-compute[73627]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 26 16:18:57 user nova-compute[73627]: and ``live_migration_inbound_addr`` respectively.
Aug 26 16:18:57 user nova-compute[73627]: ).  Its value may be silently ignored in the future.
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.live_migration_with_native_tls = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.max_queues             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.nfs_mount_options      = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.num_pcie_ports         = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.pmem_namespaces        = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.quobyte_client_cfg     = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.rbd_secret_uuid        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.rbd_user               = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.rescue_image_id        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.rescue_kernel_id       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.rx_queue_size          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.smbfs_mount_options    =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.snapshot_compression   = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.snapshot_image_format  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.sparse_logical_volumes = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.swtpm_enabled          = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.swtpm_group            = tss {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.swtpm_user             = tss {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.sysinfo_serial         = unique {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.tb_cache_size          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.tx_queue_size          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.uid_maps               = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.use_virtio_for_bridges = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.virt_type              = kvm {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.volume_clear           = zero {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.volume_clear_size      = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.volume_use_multipath   = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.vzstorage_cache_path   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.auth_section           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.auth_type              = password {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.cafile                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.certfile               = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.collect_timing         = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.connect_retries        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.connect_retry_delay    = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.default_floating_pool  = public {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.endpoint_override      = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.extension_sync_interval = 600 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.http_retries           = 3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.insecure               = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.keyfile                = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.max_version            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.min_version            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.ovs_bridge             = br-int {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.physnets               = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.region_name            = RegionOne {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.service_metadata_proxy = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.service_name           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.service_type           = network {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.split_loggers          = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.status_code_retries    = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.status_code_retry_delay = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.timeout                = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] neutron.version                = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] notifications.bdms_in_notifications = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] notifications.default_level    = INFO {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] notifications.notification_format = unversioned {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] notifications.notify_on_state_change = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] pci.alias                      = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] pci.device_spec                = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] pci.report_in_placement        = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.auth_section         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.auth_type            = password {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.cafile               = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.certfile             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.collect_timing       = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.connect_retries      = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.connect_retry_delay  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.default_domain_id    = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.default_domain_name  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.domain_id            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.domain_name          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.endpoint_override    = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.insecure             = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.keyfile              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.max_version          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.min_version          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.password             = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.project_domain_id    = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.project_domain_name  = Default {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.project_id           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.project_name         = service {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.region_name          = RegionOne {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.service_name         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.service_type         = placement {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.split_loggers        = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.status_code_retries  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.status_code_retry_delay = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.system_scope         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.timeout              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.trust_id             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.user_domain_id       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.user_domain_name     = Default {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.user_id              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.username             = placement {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] placement.version              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.cores                    = 20 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.count_usage_from_placement = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.injected_file_content_bytes = 10240 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.injected_file_path_length = 255 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.injected_files           = 5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.instances                = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.key_pairs                = 100 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.metadata_items           = 128 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.ram                      = 51200 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.recheck_quota            = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.server_group_members     = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] quota.server_groups            = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] rdp.enabled                    = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler.image_metadata_prefilter = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler.max_attempts         = 3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler.max_placement_results = 1000 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] scheduler.workers              = 3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.host_subset_size = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.isolated_hosts = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.isolated_images = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.pci_in_placement = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.track_instance_changes = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] metrics.required               = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] metrics.weight_multiplier      = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] metrics.weight_setting         = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] serial_console.enabled         = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] serial_console.port_range      = 10000:20000 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] serial_console.serialproxy_port = 6083 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] service_user.auth_section      = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] service_user.auth_type         = password {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] service_user.cafile            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] service_user.certfile          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] service_user.collect_timing    = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] service_user.insecure          = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] service_user.keyfile           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] service_user.send_service_user_token = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] service_user.split_loggers     = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] service_user.timeout           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.agent_enabled            = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.enabled                  = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.html5proxy_port          = 6082 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.image_compression        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.jpeg_compression         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.playback_compression     = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.server_listen            = 127.0.0.1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.streaming_mode           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] spice.zlib_compression         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] upgrade_levels.baseapi         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] upgrade_levels.cert            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] upgrade_levels.compute         = auto {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] upgrade_levels.conductor       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] upgrade_levels.scheduler       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vendordata_dynamic_auth.cafile = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vendordata_dynamic_auth.certfile = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vendordata_dynamic_auth.insecure = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vendordata_dynamic_auth.timeout = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.api_retry_count         = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.ca_file                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.cache_prefix            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.cluster_name            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.connection_pool_size    = 10 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.console_delay_seconds   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.datastore_regex         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.host_ip                 = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.host_password           = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.host_port               = 443 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.host_username           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.insecure                = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.integration_bridge      = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.maximum_objects         = 100 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.pbm_default_policy      = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.pbm_enabled             = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.pbm_wsdl_location       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.serial_port_proxy_uri   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.serial_port_service_uri = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.task_poll_interval      = 0.5 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.use_linked_clone        = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.vnc_keymap              = en-us {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.vnc_port                = 5900 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vmware.vnc_port_total          = 10000 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vnc.auth_schemes               = ['none'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vnc.enabled                    = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vnc.novncproxy_port            = 6080 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vnc.vencrypt_ca_certs          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vnc.vencrypt_client_cert       = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vnc.vencrypt_client_key        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.disable_rootwrap   = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.enable_numa_live_migration = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.libvirt_disable_apic = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] wsgi.client_socket_timeout     = 900 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] wsgi.default_pool_size         = 1000 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] wsgi.keep_alive                = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] wsgi.max_header_line           = 16384 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] wsgi.ssl_ca_file               = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] wsgi.ssl_cert_file             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] wsgi.ssl_key_file              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] wsgi.tcp_keepidle              = 600 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] zvm.ca_file                    = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] zvm.cloud_connector_url        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] zvm.reachable_timeout          = 300 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_policy.enforce_new_defaults = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_policy.enforce_scope      = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_policy.policy_default_rule = default {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler.connection_string     = messaging:// {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler.enabled               = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler.es_doc_type           = notification {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler.es_scroll_size        = 10000 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler.es_scroll_time        = 2m {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler.filter_error_trace    = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler.hmac_keys             = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler.sentinel_service_name = mymaster {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler.socket_timeout        = 0.1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler.trace_requests        = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler.trace_sqlalchemy      = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler_jaeger.process_tags   = {} {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler_jaeger.service_name_prefix = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] profiler_otlp.service_name_prefix = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] remote_debug.host              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] remote_debug.port              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_notifications.retry = -1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.auth_section        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.auth_type           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.cafile              = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.certfile            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.collect_timing      = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.connect_retries     = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.connect_retry_delay = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.endpoint_id         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.endpoint_override   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.insecure            = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.keyfile             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.max_version         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.min_version         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.region_name         = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.service_name        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.service_type        = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.split_loggers       = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.status_code_retries = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.status_code_retry_delay = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.timeout             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.valid_interfaces    = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_limit.version             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_reports.file_event_handler = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] oslo_reports.log_dir           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_ovs_privileged.group  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] vif_plug_ovs_privileged.user   = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_ovs.isolate_vif         = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] os_brick.lock_path             = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] privsep_osbrick.capabilities   = [21] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] privsep_osbrick.group          = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] privsep_osbrick.helper_command = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] privsep_osbrick.user           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] nova_sys_admin.group           = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] nova_sys_admin.helper_command  = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] nova_sys_admin.user            = None {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG oslo_service.service [None req-01ca7a56-d2c7-4bd9-a60b-f5e71e1f35a7 None None] ******************************************************************************** {{(pid=73627) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 26 16:18:57 user nova-compute[73627]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 26 16:18:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Starting native event thread {{(pid=73627) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Starting green dispatch thread {{(pid=73627) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Starting connection event dispatch thread {{(pid=73627) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Connecting to libvirt: qemu:///system {{(pid=73627) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe3f1786770> {{(pid=73627) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 26 16:18:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe3f1786770> {{(pid=73627) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 26 16:18:57 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Connection event '1' reason 'None'
Aug 26 16:18:57 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 16:18:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.mount [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Initialising _HostMountState generation 0 {{(pid=73627) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 26 16:19:04 user nova-compute[73627]: INFO nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Libvirt host capabilities <capabilities>
Aug 26 16:19:04 user nova-compute[73627]:   <host>
Aug 26 16:19:04 user nova-compute[73627]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 26 16:19:04 user nova-compute[73627]:     <cpu>
Aug 26 16:19:04 user nova-compute[73627]:       <arch>x86_64</arch>
Aug 26 16:19:04 user nova-compute[73627]:       <model>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <vendor>Intel</vendor>
Aug 26 16:19:04 user nova-compute[73627]:       <microcode version='1070'/>
Aug 26 16:19:04 user nova-compute[73627]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 26 16:19:04 user nova-compute[73627]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='ss'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='vmx'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='pcid'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='osxsave'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='hypervisor'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='arat'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='tsc_adjust'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='md-clear'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='arch-capabilities'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='invtsc'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='rsba'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature name='skip-l1dfl-vmentry'/>
Aug 26 16:19:04 user nova-compute[73627]:       <pages unit='KiB' size='4'/>
Aug 26 16:19:04 user nova-compute[73627]:       <pages unit='KiB' size='2048'/>
Aug 26 16:19:04 user nova-compute[73627]:     </cpu>
Aug 26 16:19:04 user nova-compute[73627]:     <power_management>
Aug 26 16:19:04 user nova-compute[73627]:       <suspend_mem/>
Aug 26 16:19:04 user nova-compute[73627]:       <suspend_disk/>
Aug 26 16:19:04 user nova-compute[73627]:       <suspend_hybrid/>
Aug 26 16:19:04 user nova-compute[73627]:     </power_management>
Aug 26 16:19:04 user nova-compute[73627]:     <iommu support='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     <migration_features>
Aug 26 16:19:04 user nova-compute[73627]:       <live/>
Aug 26 16:19:04 user nova-compute[73627]:       <uri_transports>
Aug 26 16:19:04 user nova-compute[73627]:         <uri_transport>tcp</uri_transport>
Aug 26 16:19:04 user nova-compute[73627]:         <uri_transport>rdma</uri_transport>
Aug 26 16:19:04 user nova-compute[73627]:       </uri_transports>
Aug 26 16:19:04 user nova-compute[73627]:     </migration_features>
Aug 26 16:19:04 user nova-compute[73627]:     <topology>
Aug 26 16:19:04 user nova-compute[73627]:       <cells num='2'>
Aug 26 16:19:04 user nova-compute[73627]:         <cell id='0'>
Aug 26 16:19:04 user nova-compute[73627]:           <memory unit='KiB'>8189224</memory>
Aug 26 16:19:04 user nova-compute[73627]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 26 16:19:04 user nova-compute[73627]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 16:19:04 user nova-compute[73627]:           <distances>
Aug 26 16:19:04 user nova-compute[73627]:             <sibling id='0' value='10'/>
Aug 26 16:19:04 user nova-compute[73627]:             <sibling id='1' value='20'/>
Aug 26 16:19:04 user nova-compute[73627]:           </distances>
Aug 26 16:19:04 user nova-compute[73627]:           <cpus num='6'>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 26 16:19:04 user nova-compute[73627]:           </cpus>
Aug 26 16:19:04 user nova-compute[73627]:         </cell>
Aug 26 16:19:04 user nova-compute[73627]:         <cell id='1'>
Aug 26 16:19:04 user nova-compute[73627]:           <memory unit='KiB'>8206460</memory>
Aug 26 16:19:04 user nova-compute[73627]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 26 16:19:04 user nova-compute[73627]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 16:19:04 user nova-compute[73627]:           <distances>
Aug 26 16:19:04 user nova-compute[73627]:             <sibling id='0' value='20'/>
Aug 26 16:19:04 user nova-compute[73627]:             <sibling id='1' value='10'/>
Aug 26 16:19:04 user nova-compute[73627]:           </distances>
Aug 26 16:19:04 user nova-compute[73627]:           <cpus num='6'>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 26 16:19:04 user nova-compute[73627]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 26 16:19:04 user nova-compute[73627]:           </cpus>
Aug 26 16:19:04 user nova-compute[73627]:         </cell>
Aug 26 16:19:04 user nova-compute[73627]:       </cells>
Aug 26 16:19:04 user nova-compute[73627]:     </topology>
Aug 26 16:19:04 user nova-compute[73627]:     <cache>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 26 16:19:04 user nova-compute[73627]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 26 16:19:04 user nova-compute[73627]:     </cache>
Aug 26 16:19:04 user nova-compute[73627]:     <secmodel>
Aug 26 16:19:04 user nova-compute[73627]:       <model>apparmor</model>
Aug 26 16:19:04 user nova-compute[73627]:       <doi>0</doi>
Aug 26 16:19:04 user nova-compute[73627]:     </secmodel>
Aug 26 16:19:04 user nova-compute[73627]:     <secmodel>
Aug 26 16:19:04 user nova-compute[73627]:       <model>dac</model>
Aug 26 16:19:04 user nova-compute[73627]:       <doi>0</doi>
Aug 26 16:19:04 user nova-compute[73627]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 26 16:19:04 user nova-compute[73627]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 26 16:19:04 user nova-compute[73627]:     </secmodel>
Aug 26 16:19:04 user nova-compute[73627]:   </host>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='alpha'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>64</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>clipper</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='armv6l'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>spitz</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>nuri</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>kzm</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sx1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>z2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>tosa</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>n810</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>n800</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>terrier</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>midway</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>microbit</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>verdex</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>highbank</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>akita</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>connex</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>collie</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='armv7l'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>spitz</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>nuri</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>kzm</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sx1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>z2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>tosa</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>n810</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>n800</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>terrier</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>midway</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>microbit</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>verdex</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>highbank</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>akita</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>connex</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>collie</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='aarch64'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>64</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>spitz</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>nuri</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>kzm</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sx1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>z2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>tosa</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>n810</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>n800</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>terrier</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>midway</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>microbit</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>verdex</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>raspi3b</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>highbank</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>akita</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>connex</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>collie</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <acpi default='on' toggle='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='cris'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='i686'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>isapc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>microvm</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='kvm'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <pae/>
Aug 26 16:19:04 user nova-compute[73627]:       <nonpae/>
Aug 26 16:19:04 user nova-compute[73627]:       <acpi default='on' toggle='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:       <apic default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='m68k'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>an5206</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>q800</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>next-cube</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='microblaze'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='microblazeel'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='mips'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='16'>malta</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='mipsel'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='16'>malta</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='mips64'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>64</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='16'>malta</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>pica61</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>magnum</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='mips64el'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>64</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='16'>malta</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>pica61</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>magnum</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='16'>boston</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='ppc'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mac99</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>40p</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>taihu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='ppc64'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>64</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>taihu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>40p</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mac99</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='ppc64le'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>64</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>taihu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>40p</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>mac99</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='riscv32'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='8'>spike</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>opentitan</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='8'>virt</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='riscv64'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>64</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='8'>spike</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>shakti_c</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='8'>virt</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='s390x'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>64</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='sh4'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>shix</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>r2d</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='sh4eb'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>64</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>shix</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>r2d</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='sparc'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>SS-5</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>SS-20</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>LX</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>SS-4</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>SS-10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>Voyager</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='sparc64'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>64</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sun4u</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>niagara</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>sun4v</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='x86_64'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>64</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='1'>isapc</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>microvm</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='kvm'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <acpi default='on' toggle='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:       <apic default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='xtensa'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>sim</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>kc705</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>ml605</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>virt</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>lx200</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>lx60</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]:   <guest>
Aug 26 16:19:04 user nova-compute[73627]:     <os_type>hvm</os_type>
Aug 26 16:19:04 user nova-compute[73627]:     <arch name='xtensaeb'>
Aug 26 16:19:04 user nova-compute[73627]:       <wordsize>32</wordsize>
Aug 26 16:19:04 user nova-compute[73627]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='4'>sim</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>kc705</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>ml605</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>virt</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>lx200</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>lx60</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 16:19:04 user nova-compute[73627]:       <domain type='qemu'/>
Aug 26 16:19:04 user nova-compute[73627]:     </arch>
Aug 26 16:19:04 user nova-compute[73627]:     <features>
Aug 26 16:19:04 user nova-compute[73627]:       <cpuselection/>
Aug 26 16:19:04 user nova-compute[73627]:       <deviceboot/>
Aug 26 16:19:04 user nova-compute[73627]:       <disksnapshot default='on' toggle='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     </features>
Aug 26 16:19:04 user nova-compute[73627]:   </guest>
Aug 26 16:19:04 user nova-compute[73627]: </capabilities>
Aug 26 16:19:04 user nova-compute[73627]: 
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 26 16:19:04 user nova-compute[73627]: <domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 16:19:04 user nova-compute[73627]:   <domain>kvm</domain>
Aug 26 16:19:04 user nova-compute[73627]:   <machine>pc-i440fx-jammy</machine>
Aug 26 16:19:04 user nova-compute[73627]:   <arch>i686</arch>
Aug 26 16:19:04 user nova-compute[73627]:   <vcpu max='255'/>
Aug 26 16:19:04 user nova-compute[73627]:   <iothreads supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:   <os supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='firmware'/>
Aug 26 16:19:04 user nova-compute[73627]:     <loader supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>rom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pflash</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='readonly'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>yes</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='secure'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </loader>
Aug 26 16:19:04 user nova-compute[73627]:   </os>
Aug 26 16:19:04 user nova-compute[73627]:   <cpu>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-passthrough' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='hostPassthroughMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='maximum' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='maximumMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-model' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <vendor>Intel</vendor>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ss'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='vmx'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pcid'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='hypervisor'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arat'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='umip'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='md-clear'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibpb'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibrs'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='erms'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='lm'/>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='custom' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>qemu64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>qemu32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>phenom</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>n270</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>kvm64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>coreduo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>core2duo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>athlon</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Westmere</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Snowridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Penryn</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G5</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G4</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G1</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Nehalem</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Rome</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Milan</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Dhyana</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cooperlake</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Conroe</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>486</model>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:   </cpu>
Aug 26 16:19:04 user nova-compute[73627]:   <memoryBacking supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='sourceType'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>file</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>anonymous</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>memfd</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:   </memoryBacking>
Aug 26 16:19:04 user nova-compute[73627]:   <devices>
Aug 26 16:19:04 user nova-compute[73627]:     <disk supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='diskDevice'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>disk</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cdrom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>floppy</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>lun</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='bus'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ide</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>fdc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sata</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </disk>
Aug 26 16:19:04 user nova-compute[73627]:     <graphics supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sdl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vnc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>spice</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egl-headless</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </graphics>
Aug 26 16:19:04 user nova-compute[73627]:     <video supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='modelType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cirrus</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vmvga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>qxl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>none</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>bochs</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ramfb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </video>
Aug 26 16:19:04 user nova-compute[73627]:     <hostdev supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='mode'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>subsystem</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='startupPolicy'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>default</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>mandatory</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>requisite</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>optional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='subsysType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pci</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='capsType'/>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='pciBackend'/>
Aug 26 16:19:04 user nova-compute[73627]:     </hostdev>
Aug 26 16:19:04 user nova-compute[73627]:     <rng supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>random</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egd</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>builtin</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </rng>
Aug 26 16:19:04 user nova-compute[73627]:     <filesystem supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='driverType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>path</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>handle</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtiofs</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </filesystem>
Aug 26 16:19:04 user nova-compute[73627]:     <tpm supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-tis</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-crb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>passthrough</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>emulator</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </tpm>
Aug 26 16:19:04 user nova-compute[73627]:   </devices>
Aug 26 16:19:04 user nova-compute[73627]:   <features>
Aug 26 16:19:04 user nova-compute[73627]:     <gic supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     <vmcoreinfo supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <genid supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backingStoreInput supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backup supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <sev supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:   </features>
Aug 26 16:19:04 user nova-compute[73627]: </domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:  {{(pid=73627) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 26 16:19:04 user nova-compute[73627]: <domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 16:19:04 user nova-compute[73627]:   <domain>kvm</domain>
Aug 26 16:19:04 user nova-compute[73627]:   <machine>pc-q35-jammy</machine>
Aug 26 16:19:04 user nova-compute[73627]:   <arch>i686</arch>
Aug 26 16:19:04 user nova-compute[73627]:   <vcpu max='288'/>
Aug 26 16:19:04 user nova-compute[73627]:   <iothreads supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:   <os supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='firmware'/>
Aug 26 16:19:04 user nova-compute[73627]:     <loader supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>rom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pflash</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='readonly'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>yes</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='secure'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </loader>
Aug 26 16:19:04 user nova-compute[73627]:   </os>
Aug 26 16:19:04 user nova-compute[73627]:   <cpu>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-passthrough' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='hostPassthroughMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='maximum' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='maximumMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-model' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <vendor>Intel</vendor>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ss'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='vmx'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pcid'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='hypervisor'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arat'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='umip'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='md-clear'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibpb'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibrs'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='erms'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='lm'/>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='custom' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>qemu64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>qemu32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>phenom</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>n270</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>kvm64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>coreduo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>core2duo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>athlon</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Westmere</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Snowridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Penryn</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G5</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G4</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G1</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Nehalem</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Rome</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Milan</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Dhyana</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cooperlake</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Conroe</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>486</model>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:   </cpu>
Aug 26 16:19:04 user nova-compute[73627]:   <memoryBacking supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='sourceType'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>file</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>anonymous</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>memfd</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:   </memoryBacking>
Aug 26 16:19:04 user nova-compute[73627]:   <devices>
Aug 26 16:19:04 user nova-compute[73627]:     <disk supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='diskDevice'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>disk</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cdrom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>floppy</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>lun</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='bus'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>fdc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sata</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </disk>
Aug 26 16:19:04 user nova-compute[73627]:     <graphics supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sdl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vnc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>spice</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egl-headless</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </graphics>
Aug 26 16:19:04 user nova-compute[73627]:     <video supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='modelType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cirrus</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vmvga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>qxl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>none</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>bochs</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ramfb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </video>
Aug 26 16:19:04 user nova-compute[73627]:     <hostdev supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='mode'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>subsystem</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='startupPolicy'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>default</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>mandatory</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>requisite</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>optional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='subsysType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pci</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='capsType'/>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='pciBackend'/>
Aug 26 16:19:04 user nova-compute[73627]:     </hostdev>
Aug 26 16:19:04 user nova-compute[73627]:     <rng supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>random</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egd</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>builtin</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </rng>
Aug 26 16:19:04 user nova-compute[73627]:     <filesystem supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='driverType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>path</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>handle</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtiofs</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </filesystem>
Aug 26 16:19:04 user nova-compute[73627]:     <tpm supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-tis</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-crb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>passthrough</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>emulator</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </tpm>
Aug 26 16:19:04 user nova-compute[73627]:   </devices>
Aug 26 16:19:04 user nova-compute[73627]:   <features>
Aug 26 16:19:04 user nova-compute[73627]:     <gic supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     <vmcoreinfo supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <genid supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backingStoreInput supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backup supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <sev supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:   </features>
Aug 26 16:19:04 user nova-compute[73627]: </domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:  {{(pid=73627) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 26 16:19:04 user nova-compute[73627]: <domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 16:19:04 user nova-compute[73627]:   <domain>kvm</domain>
Aug 26 16:19:04 user nova-compute[73627]:   <machine>pc-i440fx-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:   <arch>i686</arch>
Aug 26 16:19:04 user nova-compute[73627]:   <vcpu max='255'/>
Aug 26 16:19:04 user nova-compute[73627]:   <iothreads supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:   <os supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='firmware'/>
Aug 26 16:19:04 user nova-compute[73627]:     <loader supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>rom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pflash</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='readonly'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>yes</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='secure'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </loader>
Aug 26 16:19:04 user nova-compute[73627]:   </os>
Aug 26 16:19:04 user nova-compute[73627]:   <cpu>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-passthrough' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='hostPassthroughMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='maximum' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='maximumMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-model' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <vendor>Intel</vendor>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ss'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='vmx'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pcid'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='hypervisor'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arat'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='umip'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='md-clear'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibpb'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibrs'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='erms'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='lm'/>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='custom' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>qemu64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>qemu32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>phenom</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>n270</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>kvm64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>coreduo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>core2duo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>athlon</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Westmere</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Snowridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Penryn</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G5</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G4</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G1</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Nehalem</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Rome</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Milan</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Dhyana</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cooperlake</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Conroe</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>486</model>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:   </cpu>
Aug 26 16:19:04 user nova-compute[73627]:   <memoryBacking supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='sourceType'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>file</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>anonymous</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>memfd</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:   </memoryBacking>
Aug 26 16:19:04 user nova-compute[73627]:   <devices>
Aug 26 16:19:04 user nova-compute[73627]:     <disk supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='diskDevice'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>disk</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cdrom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>floppy</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>lun</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='bus'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ide</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>fdc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sata</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </disk>
Aug 26 16:19:04 user nova-compute[73627]:     <graphics supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sdl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vnc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>spice</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egl-headless</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </graphics>
Aug 26 16:19:04 user nova-compute[73627]:     <video supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='modelType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cirrus</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vmvga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>qxl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>none</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>bochs</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ramfb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </video>
Aug 26 16:19:04 user nova-compute[73627]:     <hostdev supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='mode'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>subsystem</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='startupPolicy'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>default</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>mandatory</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>requisite</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>optional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='subsysType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pci</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='capsType'/>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='pciBackend'/>
Aug 26 16:19:04 user nova-compute[73627]:     </hostdev>
Aug 26 16:19:04 user nova-compute[73627]:     <rng supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>random</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egd</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>builtin</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </rng>
Aug 26 16:19:04 user nova-compute[73627]:     <filesystem supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='driverType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>path</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>handle</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtiofs</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </filesystem>
Aug 26 16:19:04 user nova-compute[73627]:     <tpm supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-tis</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-crb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>passthrough</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>emulator</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </tpm>
Aug 26 16:19:04 user nova-compute[73627]:   </devices>
Aug 26 16:19:04 user nova-compute[73627]:   <features>
Aug 26 16:19:04 user nova-compute[73627]:     <gic supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     <vmcoreinfo supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <genid supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backingStoreInput supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backup supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <sev supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:   </features>
Aug 26 16:19:04 user nova-compute[73627]: </domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:  {{(pid=73627) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 26 16:19:04 user nova-compute[73627]: <domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 16:19:04 user nova-compute[73627]:   <domain>kvm</domain>
Aug 26 16:19:04 user nova-compute[73627]:   <machine>pc-q35-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:   <arch>i686</arch>
Aug 26 16:19:04 user nova-compute[73627]:   <vcpu max='288'/>
Aug 26 16:19:04 user nova-compute[73627]:   <iothreads supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:   <os supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='firmware'/>
Aug 26 16:19:04 user nova-compute[73627]:     <loader supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>rom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pflash</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='readonly'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>yes</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='secure'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </loader>
Aug 26 16:19:04 user nova-compute[73627]:   </os>
Aug 26 16:19:04 user nova-compute[73627]:   <cpu>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-passthrough' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='hostPassthroughMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='maximum' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='maximumMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-model' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <vendor>Intel</vendor>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ss'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='vmx'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pcid'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='hypervisor'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arat'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='umip'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='md-clear'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibpb'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibrs'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='erms'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='lm'/>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='custom' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>qemu64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>qemu32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>phenom</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>n270</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>kvm64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>coreduo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>core2duo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>athlon</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Westmere</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Snowridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Penryn</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G5</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G4</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G1</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Nehalem</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Rome</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Milan</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Dhyana</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cooperlake</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Conroe</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>486</model>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:   </cpu>
Aug 26 16:19:04 user nova-compute[73627]:   <memoryBacking supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='sourceType'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>file</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>anonymous</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>memfd</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:   </memoryBacking>
Aug 26 16:19:04 user nova-compute[73627]:   <devices>
Aug 26 16:19:04 user nova-compute[73627]:     <disk supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='diskDevice'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>disk</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cdrom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>floppy</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>lun</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='bus'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>fdc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sata</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </disk>
Aug 26 16:19:04 user nova-compute[73627]:     <graphics supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sdl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vnc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>spice</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egl-headless</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </graphics>
Aug 26 16:19:04 user nova-compute[73627]:     <video supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='modelType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cirrus</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vmvga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>qxl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>none</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>bochs</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ramfb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </video>
Aug 26 16:19:04 user nova-compute[73627]:     <hostdev supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='mode'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>subsystem</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='startupPolicy'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>default</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>mandatory</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>requisite</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>optional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='subsysType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pci</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='capsType'/>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='pciBackend'/>
Aug 26 16:19:04 user nova-compute[73627]:     </hostdev>
Aug 26 16:19:04 user nova-compute[73627]:     <rng supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>random</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egd</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>builtin</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </rng>
Aug 26 16:19:04 user nova-compute[73627]:     <filesystem supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='driverType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>path</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>handle</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtiofs</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </filesystem>
Aug 26 16:19:04 user nova-compute[73627]:     <tpm supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-tis</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-crb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>passthrough</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>emulator</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </tpm>
Aug 26 16:19:04 user nova-compute[73627]:   </devices>
Aug 26 16:19:04 user nova-compute[73627]:   <features>
Aug 26 16:19:04 user nova-compute[73627]:     <gic supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     <vmcoreinfo supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <genid supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backingStoreInput supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backup supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <sev supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:   </features>
Aug 26 16:19:04 user nova-compute[73627]: </domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:  {{(pid=73627) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 26 16:19:04 user nova-compute[73627]: <domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 16:19:04 user nova-compute[73627]:   <domain>kvm</domain>
Aug 26 16:19:04 user nova-compute[73627]:   <machine>pc-i440fx-jammy</machine>
Aug 26 16:19:04 user nova-compute[73627]:   <arch>x86_64</arch>
Aug 26 16:19:04 user nova-compute[73627]:   <vcpu max='255'/>
Aug 26 16:19:04 user nova-compute[73627]:   <iothreads supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:   <os supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='firmware'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>efi</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:     <loader supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>rom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pflash</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='readonly'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>yes</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='secure'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </loader>
Aug 26 16:19:04 user nova-compute[73627]:   </os>
Aug 26 16:19:04 user nova-compute[73627]:   <cpu>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-passthrough' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='hostPassthroughMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='maximum' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='maximumMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-model' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <vendor>Intel</vendor>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ss'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='vmx'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pcid'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='hypervisor'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arat'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='umip'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='md-clear'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='invtsc'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibpb'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibrs'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='rsba'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='erms'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='custom' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>qemu64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>qemu32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>phenom</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>n270</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>coreduo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>core2duo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>athlon</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Westmere</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Snowridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Penryn</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G5</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G4</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Opteron_G1</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Nehalem</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Rome</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Milan</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Dhyana</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cooperlake</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Conroe</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>486</model>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:   </cpu>
Aug 26 16:19:04 user nova-compute[73627]:   <memoryBacking supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='sourceType'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>file</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>anonymous</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>memfd</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:   </memoryBacking>
Aug 26 16:19:04 user nova-compute[73627]:   <devices>
Aug 26 16:19:04 user nova-compute[73627]:     <disk supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='diskDevice'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>disk</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cdrom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>floppy</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>lun</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='bus'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ide</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>fdc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sata</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </disk>
Aug 26 16:19:04 user nova-compute[73627]:     <graphics supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sdl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vnc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>spice</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egl-headless</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </graphics>
Aug 26 16:19:04 user nova-compute[73627]:     <video supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='modelType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cirrus</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vmvga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>qxl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>none</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>bochs</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ramfb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </video>
Aug 26 16:19:04 user nova-compute[73627]:     <hostdev supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='mode'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>subsystem</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='startupPolicy'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>default</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>mandatory</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>requisite</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>optional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='subsysType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pci</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='capsType'/>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='pciBackend'/>
Aug 26 16:19:04 user nova-compute[73627]:     </hostdev>
Aug 26 16:19:04 user nova-compute[73627]:     <rng supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>random</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egd</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>builtin</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </rng>
Aug 26 16:19:04 user nova-compute[73627]:     <filesystem supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='driverType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>path</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>handle</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtiofs</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </filesystem>
Aug 26 16:19:04 user nova-compute[73627]:     <tpm supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-tis</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-crb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>passthrough</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>emulator</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </tpm>
Aug 26 16:19:04 user nova-compute[73627]:   </devices>
Aug 26 16:19:04 user nova-compute[73627]:   <features>
Aug 26 16:19:04 user nova-compute[73627]:     <gic supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     <vmcoreinfo supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <genid supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backingStoreInput supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backup supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <sev supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:   </features>
Aug 26 16:19:04 user nova-compute[73627]: </domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:  {{(pid=73627) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 26 16:19:04 user nova-compute[73627]: <domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 16:19:04 user nova-compute[73627]:   <domain>kvm</domain>
Aug 26 16:19:04 user nova-compute[73627]:   <machine>pc-q35-jammy</machine>
Aug 26 16:19:04 user nova-compute[73627]:   <arch>x86_64</arch>
Aug 26 16:19:04 user nova-compute[73627]:   <vcpu max='288'/>
Aug 26 16:19:04 user nova-compute[73627]:   <iothreads supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:   <os supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='firmware'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>efi</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:     <loader supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>rom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pflash</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='readonly'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>yes</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='secure'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>yes</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </loader>
Aug 26 16:19:04 user nova-compute[73627]:   </os>
Aug 26 16:19:04 user nova-compute[73627]:   <cpu>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-passthrough' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='hostPassthroughMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='maximum' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='maximumMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-model' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <vendor>Intel</vendor>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ss'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='vmx'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pcid'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='hypervisor'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arat'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='umip'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='md-clear'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='invtsc'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibpb'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibrs'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='rsba'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='erms'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='custom' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>qemu64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>qemu32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>phenom</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>n270</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>coreduo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>core2duo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>athlon</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Westmere</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Snowridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Penryn</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G5</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G4</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Opteron_G1</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Nehalem</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Rome</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Milan</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Dhyana</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cooperlake</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Conroe</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>486</model>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:   </cpu>
Aug 26 16:19:04 user nova-compute[73627]:   <memoryBacking supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='sourceType'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>file</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>anonymous</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>memfd</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:   </memoryBacking>
Aug 26 16:19:04 user nova-compute[73627]:   <devices>
Aug 26 16:19:04 user nova-compute[73627]:     <disk supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='diskDevice'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>disk</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cdrom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>floppy</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>lun</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='bus'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>fdc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sata</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </disk>
Aug 26 16:19:04 user nova-compute[73627]:     <graphics supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sdl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vnc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>spice</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egl-headless</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </graphics>
Aug 26 16:19:04 user nova-compute[73627]:     <video supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='modelType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cirrus</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vmvga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>qxl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>none</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>bochs</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ramfb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </video>
Aug 26 16:19:04 user nova-compute[73627]:     <hostdev supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='mode'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>subsystem</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='startupPolicy'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>default</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>mandatory</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>requisite</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>optional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='subsysType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pci</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='capsType'/>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='pciBackend'/>
Aug 26 16:19:04 user nova-compute[73627]:     </hostdev>
Aug 26 16:19:04 user nova-compute[73627]:     <rng supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>random</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egd</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>builtin</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </rng>
Aug 26 16:19:04 user nova-compute[73627]:     <filesystem supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='driverType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>path</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>handle</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtiofs</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </filesystem>
Aug 26 16:19:04 user nova-compute[73627]:     <tpm supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-tis</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-crb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>passthrough</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>emulator</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </tpm>
Aug 26 16:19:04 user nova-compute[73627]:   </devices>
Aug 26 16:19:04 user nova-compute[73627]:   <features>
Aug 26 16:19:04 user nova-compute[73627]:     <gic supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     <vmcoreinfo supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <genid supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backingStoreInput supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backup supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <sev supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:   </features>
Aug 26 16:19:04 user nova-compute[73627]: </domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:  {{(pid=73627) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 26 16:19:04 user nova-compute[73627]: <domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 16:19:04 user nova-compute[73627]:   <domain>kvm</domain>
Aug 26 16:19:04 user nova-compute[73627]:   <machine>pc-i440fx-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:   <arch>x86_64</arch>
Aug 26 16:19:04 user nova-compute[73627]:   <vcpu max='255'/>
Aug 26 16:19:04 user nova-compute[73627]:   <iothreads supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:   <os supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='firmware'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>efi</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:     <loader supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>rom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pflash</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='readonly'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>yes</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='secure'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </loader>
Aug 26 16:19:04 user nova-compute[73627]:   </os>
Aug 26 16:19:04 user nova-compute[73627]:   <cpu>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-passthrough' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='hostPassthroughMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='maximum' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='maximumMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-model' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <vendor>Intel</vendor>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ss'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='vmx'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pcid'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='hypervisor'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arat'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='umip'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='md-clear'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='invtsc'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibpb'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibrs'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='rsba'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='erms'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='custom' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>qemu64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>qemu32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>phenom</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>n270</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>coreduo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>core2duo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>athlon</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Westmere</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Snowridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Penryn</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G5</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G4</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Opteron_G1</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Nehalem</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Rome</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Milan</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Dhyana</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cooperlake</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Conroe</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>486</model>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:   </cpu>
Aug 26 16:19:04 user nova-compute[73627]:   <memoryBacking supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='sourceType'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>file</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>anonymous</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>memfd</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:   </memoryBacking>
Aug 26 16:19:04 user nova-compute[73627]:   <devices>
Aug 26 16:19:04 user nova-compute[73627]:     <disk supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='diskDevice'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>disk</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cdrom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>floppy</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>lun</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='bus'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ide</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>fdc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sata</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </disk>
Aug 26 16:19:04 user nova-compute[73627]:     <graphics supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sdl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vnc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>spice</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egl-headless</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </graphics>
Aug 26 16:19:04 user nova-compute[73627]:     <video supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='modelType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cirrus</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vmvga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>qxl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>none</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>bochs</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ramfb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </video>
Aug 26 16:19:04 user nova-compute[73627]:     <hostdev supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='mode'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>subsystem</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='startupPolicy'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>default</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>mandatory</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>requisite</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>optional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='subsysType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pci</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='capsType'/>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='pciBackend'/>
Aug 26 16:19:04 user nova-compute[73627]:     </hostdev>
Aug 26 16:19:04 user nova-compute[73627]:     <rng supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>random</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egd</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>builtin</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </rng>
Aug 26 16:19:04 user nova-compute[73627]:     <filesystem supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='driverType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>path</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>handle</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtiofs</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </filesystem>
Aug 26 16:19:04 user nova-compute[73627]:     <tpm supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-tis</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-crb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>passthrough</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>emulator</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </tpm>
Aug 26 16:19:04 user nova-compute[73627]:   </devices>
Aug 26 16:19:04 user nova-compute[73627]:   <features>
Aug 26 16:19:04 user nova-compute[73627]:     <gic supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     <vmcoreinfo supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <genid supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backingStoreInput supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backup supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <sev supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:   </features>
Aug 26 16:19:04 user nova-compute[73627]: </domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:  {{(pid=73627) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 26 16:19:04 user nova-compute[73627]: <domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 16:19:04 user nova-compute[73627]:   <domain>kvm</domain>
Aug 26 16:19:04 user nova-compute[73627]:   <machine>pc-q35-6.2</machine>
Aug 26 16:19:04 user nova-compute[73627]:   <arch>x86_64</arch>
Aug 26 16:19:04 user nova-compute[73627]:   <vcpu max='288'/>
Aug 26 16:19:04 user nova-compute[73627]:   <iothreads supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:   <os supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='firmware'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>efi</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:     <loader supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>rom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pflash</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='readonly'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>yes</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='secure'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>yes</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>no</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </loader>
Aug 26 16:19:04 user nova-compute[73627]:   </os>
Aug 26 16:19:04 user nova-compute[73627]:   <cpu>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-passthrough' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='hostPassthroughMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='maximum' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='maximumMigratable'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>on</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>off</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='host-model' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <vendor>Intel</vendor>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ss'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='vmx'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pcid'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='hypervisor'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arat'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='umip'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='md-clear'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='invtsc'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibpb'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='ibrs'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-stibp'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='rsba'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='erms'/>
Aug 26 16:19:04 user nova-compute[73627]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:     <mode name='custom' supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>qemu64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>qemu32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>phenom</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>pentium</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>n270</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm64</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>kvm32</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>coreduo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>core2duo</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>athlon</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Westmere</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Snowridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Skylake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>SandyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Penryn</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G5</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G4</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G3</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Opteron_G2</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Opteron_G1</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Nehalem</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>IvyBridge</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Icelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Haswell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Rome</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-Milan</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>EPYC</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Dhyana</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cooperlake</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>Conroe</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='no'>Broadwell</model>
Aug 26 16:19:04 user nova-compute[73627]:       <model usable='yes'>486</model>
Aug 26 16:19:04 user nova-compute[73627]:     </mode>
Aug 26 16:19:04 user nova-compute[73627]:   </cpu>
Aug 26 16:19:04 user nova-compute[73627]:   <memoryBacking supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:     <enum name='sourceType'>
Aug 26 16:19:04 user nova-compute[73627]:       <value>file</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>anonymous</value>
Aug 26 16:19:04 user nova-compute[73627]:       <value>memfd</value>
Aug 26 16:19:04 user nova-compute[73627]:     </enum>
Aug 26 16:19:04 user nova-compute[73627]:   </memoryBacking>
Aug 26 16:19:04 user nova-compute[73627]:   <devices>
Aug 26 16:19:04 user nova-compute[73627]:     <disk supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='diskDevice'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>disk</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cdrom</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>floppy</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>lun</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='bus'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>fdc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sata</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </disk>
Aug 26 16:19:04 user nova-compute[73627]:     <graphics supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='type'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>sdl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vnc</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>spice</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egl-headless</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </graphics>
Aug 26 16:19:04 user nova-compute[73627]:     <video supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='modelType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>cirrus</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>vmvga</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>qxl</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>none</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>bochs</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>ramfb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </video>
Aug 26 16:19:04 user nova-compute[73627]:     <hostdev supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='mode'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>subsystem</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='startupPolicy'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>default</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>mandatory</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>requisite</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>optional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='subsysType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>usb</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>pci</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>scsi</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='capsType'/>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='pciBackend'/>
Aug 26 16:19:04 user nova-compute[73627]:     </hostdev>
Aug 26 16:19:04 user nova-compute[73627]:     <rng supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtio-non-transitional</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>random</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>egd</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>builtin</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </rng>
Aug 26 16:19:04 user nova-compute[73627]:     <filesystem supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='driverType'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>path</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>handle</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>virtiofs</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </filesystem>
Aug 26 16:19:04 user nova-compute[73627]:     <tpm supported='yes'>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='model'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-tis</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>tpm-crb</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:       <enum name='backendModel'>
Aug 26 16:19:04 user nova-compute[73627]:         <value>passthrough</value>
Aug 26 16:19:04 user nova-compute[73627]:         <value>emulator</value>
Aug 26 16:19:04 user nova-compute[73627]:       </enum>
Aug 26 16:19:04 user nova-compute[73627]:     </tpm>
Aug 26 16:19:04 user nova-compute[73627]:   </devices>
Aug 26 16:19:04 user nova-compute[73627]:   <features>
Aug 26 16:19:04 user nova-compute[73627]:     <gic supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:     <vmcoreinfo supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <genid supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backingStoreInput supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <backup supported='yes'/>
Aug 26 16:19:04 user nova-compute[73627]:     <sev supported='no'/>
Aug 26 16:19:04 user nova-compute[73627]:   </features>
Aug 26 16:19:04 user nova-compute[73627]: </domainCapabilities>
Aug 26 16:19:04 user nova-compute[73627]:  {{(pid=73627) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73627) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73627) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Checking secure boot support for host arch (x86_64) {{(pid=73627) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Checking secure boot support for host arch (x86_64) {{(pid=73627) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Checking secure boot support for host arch (x86_64) {{(pid=73627) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 16:19:04 user nova-compute[73627]: INFO nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Secure Boot support detected
Aug 26 16:19:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] cpu compare xml: <cpu match="exact">
Aug 26 16:19:04 user nova-compute[73627]:   <model>Nehalem</model>
Aug 26 16:19:04 user nova-compute[73627]: </cpu>
Aug 26 16:19:04 user nova-compute[73627]:  {{(pid=73627) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 26 16:19:04 user nova-compute[73627]: INFO nova.virt.node [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Generated node identity 8659cd71-d22c-49d8-a078-e0d0f2c22090
Aug 26 16:19:04 user nova-compute[73627]: INFO nova.virt.node [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Wrote node identity 8659cd71-d22c-49d8-a078-e0d0f2c22090 to /opt/stack/data/nova/compute_id
Aug 26 16:19:04 user nova-compute[73627]: WARNING nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Compute nodes ['8659cd71-d22c-49d8-a078-e0d0f2c22090'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 26 16:19:05 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 26 16:19:05 user nova-compute[73627]: WARNING nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 16:19:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:19:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:19:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:19:05 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:19:05 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:19:05 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:19:05 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Hypervisor/Node resource view: name=user free_ram=10892MB free_disk=26.312538146972656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:19:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:19:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:19:05 user nova-compute[73627]: WARNING nova.compute.resource_tracker [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] No compute node record for user:8659cd71-d22c-49d8-a078-e0d0f2c22090: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 8659cd71-d22c-49d8-a078-e0d0f2c22090 could not be found.
Aug 26 16:19:05 user nova-compute[73627]: INFO nova.compute.resource_tracker [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Compute node record created for user:user with uuid: 8659cd71-d22c-49d8-a078-e0d0f2c22090
Aug 26 16:19:05 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:19:05 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:19:05 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [req-fcc654e3-0b37-46ae-9e76-7cba34783dbb] Created resource provider record via placement API for resource provider with UUID 8659cd71-d22c-49d8-a078-e0d0f2c22090 and name user.
Aug 26 16:19:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73627) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 26 16:19:05 user nova-compute[73627]: INFO nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] kernel doesn't support AMD SEV
Aug 26 16:19:05 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Updating inventory in ProviderTree for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 16:19:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:19:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Libvirt baseline CPU <cpu>
Aug 26 16:19:05 user nova-compute[73627]:   <arch>x86_64</arch>
Aug 26 16:19:05 user nova-compute[73627]:   <model>Nehalem</model>
Aug 26 16:19:05 user nova-compute[73627]:   <vendor>Intel</vendor>
Aug 26 16:19:05 user nova-compute[73627]:   <topology sockets="6" cores="1" threads="1"/>
Aug 26 16:19:05 user nova-compute[73627]: </cpu>
Aug 26 16:19:05 user nova-compute[73627]:  {{(pid=73627) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 26 16:19:05 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Updated inventory for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 26 16:19:05 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Updating resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 generation from 0 to 1 during operation: update_inventory {{(pid=73627) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 16:19:05 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Updating inventory in ProviderTree for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 16:19:06 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Updating resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 generation from 1 to 2 during operation: update_traits {{(pid=73627) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 16:19:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:19:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.686s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:19:06 user nova-compute[73627]: DEBUG nova.service [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Creating RPC server for service compute {{(pid=73627) start /opt/stack/nova/nova/service.py:182}}
Aug 26 16:19:06 user nova-compute[73627]: DEBUG nova.service [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Join ServiceGroup membership for this service compute {{(pid=73627) start /opt/stack/nova/nova/service.py:199}}
Aug 26 16:19:06 user nova-compute[73627]: DEBUG nova.servicegroup.drivers.db [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73627) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 26 16:19:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:19:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:19:56 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:19:56 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:19:56 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=10241MB free_disk=26.216251373291016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:19:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:19:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:19:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:19:57 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:19:57 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:19:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:19:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:20:57 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:20:57 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:20:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=10219MB free_disk=26.262474060058594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:20:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:20:58 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:20:58 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:20:58 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:20:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:20:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:20:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 16:20:58 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:20:58 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:20:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:21:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:21:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:21:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:21:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:21:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:21:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:21:56 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:21:57 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:21:57 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:21:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=10252MB free_disk=26.046588897705078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:21:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:21:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:21:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:21:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:21:57 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:21:57 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:21:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:21:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:21:58 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:21:58 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:21:58 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:21:59 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:21:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:21:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:21:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 16:21:59 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:21:59 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:21:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:22:57 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:22:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:22:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:22:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:22:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:22:58 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:22:58 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:22:58 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=9525MB free_disk=26.069854736328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:22:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:22:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:22:58 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:22:58 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:22:58 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:22:58 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:22:58 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:22:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:22:59 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:22:59 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:22:59 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:23:00 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:23:00 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:23:00 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:23:00 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:23:00 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:23:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:23:01 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:23:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:23:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:23:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 16:23:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:23:07 user nova-compute[73627]: INFO nova.compute.claims [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Claim successful on node user
Aug 26 16:23:07 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "8164bb99-842e-49fc-8f36-093de455c311" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "8164bb99-842e-49fc-8f36-093de455c311" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:07 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:23:07 user nova-compute[73627]: INFO nova.compute.claims [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Claim successful on node user
Aug 26 16:23:07 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:23:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:23:08 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Creating image(s)
Aug 26 16:23:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "/opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "/opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "/opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.035s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG nova.compute.manager [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG nova.compute.manager [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG nova.network.neutron [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:23:08 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:23:08 user nova-compute[73627]: DEBUG nova.compute.manager [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7.part --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG nova.policy [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f24169ea97724e1288631ea977a068bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b8b30c15b8423e90156082111b000f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG nova.policy [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cff4ef247a7f4742bf3e9d52f13f8a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43cbe040c162469897bb683eeff4d543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:23:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Creating image(s)
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "/opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "/opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "/opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7.part --force-share --output=json" returned: 0 in 0.208s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG nova.virt.images [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] 7c378a38-67f2-4800-b3b2-bf66a493a20b was qcow2, converting to raw {{(pid=73627) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7.part /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7.converted {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:23:09 user nova-compute[73627]: INFO nova.compute.claims [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Claim successful on node user
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7.part /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7.converted" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7.converted --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.425s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:09 user nova-compute[73627]: INFO oslo.privsep.daemon [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxeesg63j/privsep.sock']
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.423s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:09 user sudo[82853]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxeesg63j/privsep.sock
Aug 26 16:23:09 user sudo[82853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 16:23:09 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:23:10 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:23:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:23:10 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Creating image(s)
Aug 26 16:23:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "/opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "a6f68ea4-789d-4456-a82d-d067384b566b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG nova.policy [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acdf029015a64f89aa51e6559e0f962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6269e1e9de40b5a5b295651a6fd9b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:23:10 user nova-compute[73627]: INFO nova.compute.claims [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Claim successful on node user
Aug 26 16:23:10 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:23:10 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:23:11 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:23:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:23:11 user sudo[82853]: pam_unix(sudo:session): session closed for user root
Aug 26 16:23:11 user nova-compute[73627]: INFO oslo.privsep.daemon [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Spawned new privsep daemon via rootwrap
Aug 26 16:23:11 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 16:23:11 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 16:23:11 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 16:23:11 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82908
Aug 26 16:23:11 user nova-compute[73627]: WARNING oslo_privsep.priv_context [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] privsep daemon already running
Aug 26 16:23:11 user nova-compute[73627]: WARNING oslo_privsep.priv_context [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] privsep daemon already running
Aug 26 16:23:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:23:11 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Creating image(s)
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG nova.policy [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acdf029015a64f89aa51e6559e0f962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6269e1e9de40b5a5b295651a6fd9b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.218s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.192s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.228s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Successfully created port: 4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Successfully created port: 241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk 1073741824" returned: 0 in 0.050s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.245s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.169s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.164s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk 1073741824" returned: 0 in 0.047s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.494s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Cannot resize image /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Ensure instance console log exists: /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk 1073741824" returned: 0 in 0.045s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.716s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Cannot resize image /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Ensure instance console log exists: /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk 1073741824" returned: 0 in 0.051s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Cannot resize image /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Ensure instance console log exists: /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.167s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:23:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:13 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Cannot resize image /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:23:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:23:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Ensure instance console log exists: /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:23:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:13 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Successfully created port: 7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:23:14 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Successfully created port: afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:23:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Successfully updated port: 241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:23:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Successfully updated port: 4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:23:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquired lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "refresh_cache-09d293f0-0c31-4d11-8ba3-b6e2e4881c42" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquired lock "refresh_cache-09d293f0-0c31-4d11-8ba3-b6e2e4881c42" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-cf059324-7be2-4e6d-bbd3-828c1247277a req-f30e8759-5efb-4663-93e4-0e0d3d51845f service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Received event network-changed-241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-cf059324-7be2-4e6d-bbd3-828c1247277a req-f30e8759-5efb-4663-93e4-0e0d3d51845f service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Refreshing instance network info cache due to event network-changed-241ea534-a7ce-437b-9e82-8ed8ffe61c09. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cf059324-7be2-4e6d-bbd3-828c1247277a req-f30e8759-5efb-4663-93e4-0e0d3d51845f service nova] Acquiring lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-6c56301a-0659-47ee-9bdc-dcdb25229bb2 req-58663694-faa4-4ccd-96b4-8aed2d814ae2 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-changed-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-6c56301a-0659-47ee-9bdc-dcdb25229bb2 req-58663694-faa4-4ccd-96b4-8aed2d814ae2 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Refreshing instance network info cache due to event network-changed-4905f341-d7d6-47da-b6b2-1dd43d93133d. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c56301a-0659-47ee-9bdc-dcdb25229bb2 req-58663694-faa4-4ccd-96b4-8aed2d814ae2 service nova] Acquiring lock "refresh_cache-09d293f0-0c31-4d11-8ba3-b6e2e4881c42" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Successfully updated port: 7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquired lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-a55db962-713a-4c46-b981-ee24a49e47f7 req-58767a71-0fda-44c9-8564-9aa777b159c7 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-changed-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-a55db962-713a-4c46-b981-ee24a49e47f7 req-58767a71-0fda-44c9-8564-9aa777b159c7 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Refreshing instance network info cache due to event network-changed-7b801568-1011-4cc6-8a1b-b15d44abf741. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a55db962-713a-4c46-b981-ee24a49e47f7 req-58767a71-0fda-44c9-8564-9aa777b159c7 service nova] Acquiring lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.network.neutron [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Updating instance_info_cache with network_info: [{"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Releasing lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Instance network_info: |[{"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cf059324-7be2-4e6d-bbd3-828c1247277a req-f30e8759-5efb-4663-93e4-0e0d3d51845f service nova] Acquired lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.network.neutron [req-cf059324-7be2-4e6d-bbd3-828c1247277a req-f30e8759-5efb-4663-93e4-0e0d3d51845f service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Refreshing network info cache for port 241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Start _get_guest_xml network_info=[{"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:23:17 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:17 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-597401726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-597401726',id=2,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b8b30c15b8423e90156082111b000f',ramdisk_id='',reservation_id='r-3f0s15f4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:08Z,user_data=None,user_id='f24169ea97724e1288631ea977a068bd',uuid=8164bb99-842e-49fc-8f36-093de455c311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converting VIF {"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fa:c8,bridge_name='br-int',has_traffic_filtering=True,id=241ea534-a7ce-437b-9e82-8ed8ffe61c09,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241ea534-a7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.objects.instance [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'pci_devices' on Instance uuid 8164bb99-842e-49fc-8f36-093de455c311 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:23:17 user nova-compute[73627]:   <uuid>8164bb99-842e-49fc-8f36-093de455c311</uuid>
Aug 26 16:23:17 user nova-compute[73627]:   <name>instance-00000002</name>
Aug 26 16:23:17 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:23:17 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:23:17 user nova-compute[73627]:   <metadata>
Aug 26 16:23:17 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:23:17 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:23:17 user nova-compute[73627]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-597401726</nova:name>
Aug 26 16:23:17 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:23:17</nova:creationTime>
Aug 26 16:23:17 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:23:17 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:23:17 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:23:17 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:23:17 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:23:17 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:23:17 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:23:17 user nova-compute[73627]:       <nova:owner>
Aug 26 16:23:17 user nova-compute[73627]:         <nova:user uuid="f24169ea97724e1288631ea977a068bd">tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member</nova:user>
Aug 26 16:23:17 user nova-compute[73627]:         <nova:project uuid="c8b8b30c15b8423e90156082111b000f">tempest-ServerBootFromVolumeStableRescueTest-2135030864</nova:project>
Aug 26 16:23:17 user nova-compute[73627]:       </nova:owner>
Aug 26 16:23:17 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:23:17 user nova-compute[73627]:       <nova:ports>
Aug 26 16:23:17 user nova-compute[73627]:         <nova:port uuid="241ea534-a7ce-437b-9e82-8ed8ffe61c09">
Aug 26 16:23:17 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 16:23:17 user nova-compute[73627]:         </nova:port>
Aug 26 16:23:17 user nova-compute[73627]:       </nova:ports>
Aug 26 16:23:17 user nova-compute[73627]:     </nova:instance>
Aug 26 16:23:17 user nova-compute[73627]:   </metadata>
Aug 26 16:23:17 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:23:17 user nova-compute[73627]:     <system>
Aug 26 16:23:17 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:23:17 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:23:17 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:23:17 user nova-compute[73627]:       <entry name="serial">8164bb99-842e-49fc-8f36-093de455c311</entry>
Aug 26 16:23:17 user nova-compute[73627]:       <entry name="uuid">8164bb99-842e-49fc-8f36-093de455c311</entry>
Aug 26 16:23:17 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:23:17 user nova-compute[73627]:     </system>
Aug 26 16:23:17 user nova-compute[73627]:   </sysinfo>
Aug 26 16:23:17 user nova-compute[73627]:   <os>
Aug 26 16:23:17 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:23:17 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:23:17 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:23:17 user nova-compute[73627]:   </os>
Aug 26 16:23:17 user nova-compute[73627]:   <features>
Aug 26 16:23:17 user nova-compute[73627]:     <acpi/>
Aug 26 16:23:17 user nova-compute[73627]:     <apic/>
Aug 26 16:23:17 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:23:17 user nova-compute[73627]:   </features>
Aug 26 16:23:17 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:23:17 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:23:17 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:23:17 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:23:17 user nova-compute[73627]:   </clock>
Aug 26 16:23:17 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:23:17 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:23:17 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:23:17 user nova-compute[73627]:   </cpu>
Aug 26 16:23:17 user nova-compute[73627]:   <devices>
Aug 26 16:23:17 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:23:17 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:23:17 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk"/>
Aug 26 16:23:17 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:23:17 user nova-compute[73627]:     </disk>
Aug 26 16:23:17 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:23:17 user nova-compute[73627]:       <mac address="fa:16:3e:d2:fa:c8"/>
Aug 26 16:23:17 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:17 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:23:17 user nova-compute[73627]:       <target dev="tap241ea534-a7"/>
Aug 26 16:23:17 user nova-compute[73627]:     </interface>
Aug 26 16:23:17 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:23:17 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/console.log" append="off"/>
Aug 26 16:23:17 user nova-compute[73627]:     </serial>
Aug 26 16:23:17 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:23:17 user nova-compute[73627]:     <video>
Aug 26 16:23:17 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:17 user nova-compute[73627]:     </video>
Aug 26 16:23:17 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:23:17 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:23:17 user nova-compute[73627]:     </rng>
Aug 26 16:23:17 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:23:17 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:23:17 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:23:17 user nova-compute[73627]:     </memballoon>
Aug 26 16:23:17 user nova-compute[73627]:   </devices>
Aug 26 16:23:17 user nova-compute[73627]: </domain>
Aug 26 16:23:17 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-597401726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-597401726',id=2,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b8b30c15b8423e90156082111b000f',ramdisk_id='',reservation_id='r-3f0s15f4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:08Z,user_data=None,user_id='f24169ea97724e1288631ea977a068bd',uuid=8164bb99-842e-49fc-8f36-093de455c311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converting VIF {"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fa:c8,bridge_name='br-int',has_traffic_filtering=True,id=241ea534-a7ce-437b-9e82-8ed8ffe61c09,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241ea534-a7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG os_vif [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fa:c8,bridge_name='br-int',has_traffic_filtering=True,id=241ea534-a7ce-437b-9e82-8ed8ffe61c09,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241ea534-a7') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Updating instance_info_cache with network_info: [{"id": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "address": "fa:16:3e:14:39:70", "network": {"id": "1a393b72-2045-4ad2-b823-8dd0a0239bf5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2041643108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43cbe040c162469897bb683eeff4d543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4905f341-d7", "ovs_interfaceid": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Created schema index Interface.name {{(pid=73627) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Created schema index Port.name {{(pid=73627) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Created schema index Bridge.name {{(pid=73627) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [POLLOUT] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Releasing lock "refresh_cache-09d293f0-0c31-4d11-8ba3-b6e2e4881c42" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Instance network_info: |[{"id": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "address": "fa:16:3e:14:39:70", "network": {"id": "1a393b72-2045-4ad2-b823-8dd0a0239bf5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2041643108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43cbe040c162469897bb683eeff4d543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4905f341-d7", "ovs_interfaceid": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c56301a-0659-47ee-9bdc-dcdb25229bb2 req-58663694-faa4-4ccd-96b4-8aed2d814ae2 service nova] Acquired lock "refresh_cache-09d293f0-0c31-4d11-8ba3-b6e2e4881c42" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c56301a-0659-47ee-9bdc-dcdb25229bb2 req-58663694-faa4-4ccd-96b4-8aed2d814ae2 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Refreshing network info cache for port 4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Start _get_guest_xml network_info=[{"id": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "address": "fa:16:3e:14:39:70", "network": {"id": "1a393b72-2045-4ad2-b823-8dd0a0239bf5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2041643108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43cbe040c162469897bb683eeff4d543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4905f341-d7", "ovs_interfaceid": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:23:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Successfully updated port: afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquired lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:23:18 user nova-compute[73627]: INFO oslo.privsep.daemon [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpzb9a1hko/privsep.sock']
Aug 26 16:23:18 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:18 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:18 user sudo[82983]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpzb9a1hko/privsep.sock
Aug 26 16:23:18 user sudo[82983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-534747565',display_name='tempest-DeleteServersTestJSON-server-534747565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-534747565',id=1,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43cbe040c162469897bb683eeff4d543',ramdisk_id='',reservation_id='r-085whfu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1234185935',owner_user_name='tempest-DeleteServersTestJSON-1234185935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:08Z,user_data=None,user_id='cff4ef247a7f4742bf3e9d52f13f8a3b',uuid=09d293f0-0c31-4d11-8ba3-b6e2e4881c42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "address": "fa:16:3e:14:39:70", "network": {"id": "1a393b72-2045-4ad2-b823-8dd0a0239bf5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2041643108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43cbe040c162469897bb683eeff4d543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4905f341-d7", "ovs_interfaceid": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Converting VIF {"id": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "address": "fa:16:3e:14:39:70", "network": {"id": "1a393b72-2045-4ad2-b823-8dd0a0239bf5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2041643108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43cbe040c162469897bb683eeff4d543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4905f341-d7", "ovs_interfaceid": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:39:70,bridge_name='br-int',has_traffic_filtering=True,id=4905f341-d7d6-47da-b6b2-1dd43d93133d,network=Network(1a393b72-2045-4ad2-b823-8dd0a0239bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4905f341-d7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.objects.instance [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lazy-loading 'pci_devices' on Instance uuid 09d293f0-0c31-4d11-8ba3-b6e2e4881c42 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:23:18 user nova-compute[73627]:   <uuid>09d293f0-0c31-4d11-8ba3-b6e2e4881c42</uuid>
Aug 26 16:23:18 user nova-compute[73627]:   <name>instance-00000001</name>
Aug 26 16:23:18 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:23:18 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:23:18 user nova-compute[73627]:   <metadata>
Aug 26 16:23:18 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:23:18 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:name>tempest-DeleteServersTestJSON-server-534747565</nova:name>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:23:18</nova:creationTime>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:23:18 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:23:18 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:owner>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:user uuid="cff4ef247a7f4742bf3e9d52f13f8a3b">tempest-DeleteServersTestJSON-1234185935-project-member</nova:user>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:project uuid="43cbe040c162469897bb683eeff4d543">tempest-DeleteServersTestJSON-1234185935</nova:project>
Aug 26 16:23:18 user nova-compute[73627]:       </nova:owner>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:ports>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:port uuid="4905f341-d7d6-47da-b6b2-1dd43d93133d">
Aug 26 16:23:18 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 16:23:18 user nova-compute[73627]:         </nova:port>
Aug 26 16:23:18 user nova-compute[73627]:       </nova:ports>
Aug 26 16:23:18 user nova-compute[73627]:     </nova:instance>
Aug 26 16:23:18 user nova-compute[73627]:   </metadata>
Aug 26 16:23:18 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:23:18 user nova-compute[73627]:     <system>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="serial">09d293f0-0c31-4d11-8ba3-b6e2e4881c42</entry>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="uuid">09d293f0-0c31-4d11-8ba3-b6e2e4881c42</entry>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:23:18 user nova-compute[73627]:     </system>
Aug 26 16:23:18 user nova-compute[73627]:   </sysinfo>
Aug 26 16:23:18 user nova-compute[73627]:   <os>
Aug 26 16:23:18 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:23:18 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:23:18 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:23:18 user nova-compute[73627]:   </os>
Aug 26 16:23:18 user nova-compute[73627]:   <features>
Aug 26 16:23:18 user nova-compute[73627]:     <acpi/>
Aug 26 16:23:18 user nova-compute[73627]:     <apic/>
Aug 26 16:23:18 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:23:18 user nova-compute[73627]:   </features>
Aug 26 16:23:18 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:23:18 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:23:18 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:23:18 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:23:18 user nova-compute[73627]:   </clock>
Aug 26 16:23:18 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:23:18 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:23:18 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:23:18 user nova-compute[73627]:   </cpu>
Aug 26 16:23:18 user nova-compute[73627]:   <devices>
Aug 26 16:23:18 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:23:18 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:23:18 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk"/>
Aug 26 16:23:18 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:23:18 user nova-compute[73627]:     </disk>
Aug 26 16:23:18 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:23:18 user nova-compute[73627]:       <mac address="fa:16:3e:14:39:70"/>
Aug 26 16:23:18 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:18 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:23:18 user nova-compute[73627]:       <target dev="tap4905f341-d7"/>
Aug 26 16:23:18 user nova-compute[73627]:     </interface>
Aug 26 16:23:18 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:23:18 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/console.log" append="off"/>
Aug 26 16:23:18 user nova-compute[73627]:     </serial>
Aug 26 16:23:18 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:23:18 user nova-compute[73627]:     <video>
Aug 26 16:23:18 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:18 user nova-compute[73627]:     </video>
Aug 26 16:23:18 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:23:18 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:23:18 user nova-compute[73627]:     </rng>
Aug 26 16:23:18 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:23:18 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:23:18 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:23:18 user nova-compute[73627]:     </memballoon>
Aug 26 16:23:18 user nova-compute[73627]:   </devices>
Aug 26 16:23:18 user nova-compute[73627]: </domain>
Aug 26 16:23:18 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-534747565',display_name='tempest-DeleteServersTestJSON-server-534747565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-534747565',id=1,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43cbe040c162469897bb683eeff4d543',ramdisk_id='',reservation_id='r-085whfu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1234185935',owner_user_name='tempest-DeleteServersTestJSON-1234185935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:08Z,user_data=None,user_id='cff4ef247a7f4742bf3e9d52f13f8a3b',uuid=09d293f0-0c31-4d11-8ba3-b6e2e4881c42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "address": "fa:16:3e:14:39:70", "network": {"id": "1a393b72-2045-4ad2-b823-8dd0a0239bf5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2041643108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43cbe040c162469897bb683eeff4d543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4905f341-d7", "ovs_interfaceid": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Converting VIF {"id": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "address": "fa:16:3e:14:39:70", "network": {"id": "1a393b72-2045-4ad2-b823-8dd0a0239bf5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2041643108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43cbe040c162469897bb683eeff4d543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4905f341-d7", "ovs_interfaceid": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:39:70,bridge_name='br-int',has_traffic_filtering=True,id=4905f341-d7d6-47da-b6b2-1dd43d93133d,network=Network(1a393b72-2045-4ad2-b823-8dd0a0239bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4905f341-d7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG os_vif [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:39:70,bridge_name='br-int',has_traffic_filtering=True,id=4905f341-d7d6-47da-b6b2-1dd43d93133d,network=Network(1a393b72-2045-4ad2-b823-8dd0a0239bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4905f341-d7') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updating instance_info_cache with network_info: [{"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Releasing lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Instance network_info: |[{"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a55db962-713a-4c46-b981-ee24a49e47f7 req-58767a71-0fda-44c9-8564-9aa777b159c7 service nova] Acquired lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.neutron [req-a55db962-713a-4c46-b981-ee24a49e47f7 req-58767a71-0fda-44c9-8564-9aa777b159c7 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Refreshing network info cache for port 7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Start _get_guest_xml network_info=[{"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:23:18 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:18 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1444531241',display_name='tempest-ServerRescueNegativeTestJSON-server-1444531241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1444531241',id=3,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-ec4k8e0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:10Z,user_data=None,user_id='acdf029015a64f89aa51e6559e0f962c',uuid=6907d670-3efe-473c-b03c-eb26c4b7ef4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:0b:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b801568-1011-4cc6-8a1b-b15d44abf741,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b801568-10') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.objects.instance [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'pci_devices' on Instance uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.compute.manager [req-9f6e9309-e331-435d-9925-a89f54475b17 req-0fe55a9e-0b2b-40ae-853c-bc58732cfebc service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-changed-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.compute.manager [req-9f6e9309-e331-435d-9925-a89f54475b17 req-0fe55a9e-0b2b-40ae-853c-bc58732cfebc service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Refreshing instance network info cache due to event network-changed-afd1a924-cb15-439a-b687-1dde16f591d5. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9f6e9309-e331-435d-9925-a89f54475b17 req-0fe55a9e-0b2b-40ae-853c-bc58732cfebc service nova] Acquiring lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:23:18 user nova-compute[73627]:   <uuid>6907d670-3efe-473c-b03c-eb26c4b7ef4e</uuid>
Aug 26 16:23:18 user nova-compute[73627]:   <name>instance-00000003</name>
Aug 26 16:23:18 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:23:18 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:23:18 user nova-compute[73627]:   <metadata>
Aug 26 16:23:18 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:23:18 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1444531241</nova:name>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:23:18</nova:creationTime>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:23:18 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:23:18 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:owner>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:user uuid="acdf029015a64f89aa51e6559e0f962c">tempest-ServerRescueNegativeTestJSON-1187038007-project-member</nova:user>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:project uuid="9f6269e1e9de40b5a5b295651a6fd9b3">tempest-ServerRescueNegativeTestJSON-1187038007</nova:project>
Aug 26 16:23:18 user nova-compute[73627]:       </nova:owner>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:23:18 user nova-compute[73627]:       <nova:ports>
Aug 26 16:23:18 user nova-compute[73627]:         <nova:port uuid="7b801568-1011-4cc6-8a1b-b15d44abf741">
Aug 26 16:23:18 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 16:23:18 user nova-compute[73627]:         </nova:port>
Aug 26 16:23:18 user nova-compute[73627]:       </nova:ports>
Aug 26 16:23:18 user nova-compute[73627]:     </nova:instance>
Aug 26 16:23:18 user nova-compute[73627]:   </metadata>
Aug 26 16:23:18 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:23:18 user nova-compute[73627]:     <system>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="serial">6907d670-3efe-473c-b03c-eb26c4b7ef4e</entry>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="uuid">6907d670-3efe-473c-b03c-eb26c4b7ef4e</entry>
Aug 26 16:23:18 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:23:18 user nova-compute[73627]:     </system>
Aug 26 16:23:18 user nova-compute[73627]:   </sysinfo>
Aug 26 16:23:18 user nova-compute[73627]:   <os>
Aug 26 16:23:18 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:23:18 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:23:18 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:23:18 user nova-compute[73627]:   </os>
Aug 26 16:23:18 user nova-compute[73627]:   <features>
Aug 26 16:23:18 user nova-compute[73627]:     <acpi/>
Aug 26 16:23:18 user nova-compute[73627]:     <apic/>
Aug 26 16:23:18 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:23:18 user nova-compute[73627]:   </features>
Aug 26 16:23:18 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:23:18 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:23:18 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:23:18 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:23:18 user nova-compute[73627]:   </clock>
Aug 26 16:23:18 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:23:18 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:23:18 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:23:18 user nova-compute[73627]:   </cpu>
Aug 26 16:23:18 user nova-compute[73627]:   <devices>
Aug 26 16:23:18 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:23:18 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:23:18 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk"/>
Aug 26 16:23:18 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:23:18 user nova-compute[73627]:     </disk>
Aug 26 16:23:18 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:23:18 user nova-compute[73627]:       <mac address="fa:16:3e:92:0b:2d"/>
Aug 26 16:23:18 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:18 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:23:18 user nova-compute[73627]:       <target dev="tap7b801568-10"/>
Aug 26 16:23:18 user nova-compute[73627]:     </interface>
Aug 26 16:23:18 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:23:18 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/console.log" append="off"/>
Aug 26 16:23:18 user nova-compute[73627]:     </serial>
Aug 26 16:23:18 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:23:18 user nova-compute[73627]:     <video>
Aug 26 16:23:18 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:18 user nova-compute[73627]:     </video>
Aug 26 16:23:18 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:23:18 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:23:18 user nova-compute[73627]:     </rng>
Aug 26 16:23:18 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:23:18 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:23:18 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:23:18 user nova-compute[73627]:     </memballoon>
Aug 26 16:23:18 user nova-compute[73627]:   </devices>
Aug 26 16:23:18 user nova-compute[73627]: </domain>
Aug 26 16:23:18 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1444531241',display_name='tempest-ServerRescueNegativeTestJSON-server-1444531241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1444531241',id=3,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-ec4k8e0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:10Z,user_data=None,user_id='acdf029015a64f89aa51e6559e0f962c',uuid=6907d670-3efe-473c-b03c-eb26c4b7ef4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:0b:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b801568-1011-4cc6-8a1b-b15d44abf741,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b801568-10') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG os_vif [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:0b:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b801568-1011-4cc6-8a1b-b15d44abf741,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b801568-10') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:23:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Updating instance_info_cache with network_info: [{"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Releasing lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Instance network_info: |[{"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9f6e9309-e331-435d-9925-a89f54475b17 req-0fe55a9e-0b2b-40ae-853c-bc58732cfebc service nova] Acquired lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.network.neutron [req-9f6e9309-e331-435d-9925-a89f54475b17 req-0fe55a9e-0b2b-40ae-853c-bc58732cfebc service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Refreshing network info cache for port afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Start _get_guest_xml network_info=[{"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:23:19 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:19 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-167969385',display_name='tempest-ServerRescueNegativeTestJSON-server-167969385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-167969385',id=4,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-atgh31tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:11Z,user_data=None,user_id='acdf029015a64f89aa51e6559e0f962c',uuid=a6f68ea4-789d-4456-a82d-d067384b566b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:c3,bridge_name='br-int',has_traffic_filtering=True,id=afd1a924-cb15-439a-b687-1dde16f591d5,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd1a924-cb') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'pci_devices' on Instance uuid a6f68ea4-789d-4456-a82d-d067384b566b {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:23:19 user nova-compute[73627]:   <uuid>a6f68ea4-789d-4456-a82d-d067384b566b</uuid>
Aug 26 16:23:19 user nova-compute[73627]:   <name>instance-00000004</name>
Aug 26 16:23:19 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:23:19 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:23:19 user nova-compute[73627]:   <metadata>
Aug 26 16:23:19 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:23:19 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:23:19 user nova-compute[73627]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-167969385</nova:name>
Aug 26 16:23:19 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:23:19</nova:creationTime>
Aug 26 16:23:19 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:23:19 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:23:19 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:23:19 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:23:19 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:23:19 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:23:19 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:23:19 user nova-compute[73627]:       <nova:owner>
Aug 26 16:23:19 user nova-compute[73627]:         <nova:user uuid="acdf029015a64f89aa51e6559e0f962c">tempest-ServerRescueNegativeTestJSON-1187038007-project-member</nova:user>
Aug 26 16:23:19 user nova-compute[73627]:         <nova:project uuid="9f6269e1e9de40b5a5b295651a6fd9b3">tempest-ServerRescueNegativeTestJSON-1187038007</nova:project>
Aug 26 16:23:19 user nova-compute[73627]:       </nova:owner>
Aug 26 16:23:19 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:23:19 user nova-compute[73627]:       <nova:ports>
Aug 26 16:23:19 user nova-compute[73627]:         <nova:port uuid="afd1a924-cb15-439a-b687-1dde16f591d5">
Aug 26 16:23:19 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 16:23:19 user nova-compute[73627]:         </nova:port>
Aug 26 16:23:19 user nova-compute[73627]:       </nova:ports>
Aug 26 16:23:19 user nova-compute[73627]:     </nova:instance>
Aug 26 16:23:19 user nova-compute[73627]:   </metadata>
Aug 26 16:23:19 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:23:19 user nova-compute[73627]:     <system>
Aug 26 16:23:19 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:23:19 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:23:19 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:23:19 user nova-compute[73627]:       <entry name="serial">a6f68ea4-789d-4456-a82d-d067384b566b</entry>
Aug 26 16:23:19 user nova-compute[73627]:       <entry name="uuid">a6f68ea4-789d-4456-a82d-d067384b566b</entry>
Aug 26 16:23:19 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:23:19 user nova-compute[73627]:     </system>
Aug 26 16:23:19 user nova-compute[73627]:   </sysinfo>
Aug 26 16:23:19 user nova-compute[73627]:   <os>
Aug 26 16:23:19 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:23:19 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:23:19 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:23:19 user nova-compute[73627]:   </os>
Aug 26 16:23:19 user nova-compute[73627]:   <features>
Aug 26 16:23:19 user nova-compute[73627]:     <acpi/>
Aug 26 16:23:19 user nova-compute[73627]:     <apic/>
Aug 26 16:23:19 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:23:19 user nova-compute[73627]:   </features>
Aug 26 16:23:19 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:23:19 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:23:19 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:23:19 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:23:19 user nova-compute[73627]:   </clock>
Aug 26 16:23:19 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:23:19 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:23:19 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:23:19 user nova-compute[73627]:   </cpu>
Aug 26 16:23:19 user nova-compute[73627]:   <devices>
Aug 26 16:23:19 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:23:19 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:23:19 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk"/>
Aug 26 16:23:19 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:23:19 user nova-compute[73627]:     </disk>
Aug 26 16:23:19 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:23:19 user nova-compute[73627]:       <mac address="fa:16:3e:89:b1:c3"/>
Aug 26 16:23:19 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:19 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:23:19 user nova-compute[73627]:       <target dev="tapafd1a924-cb"/>
Aug 26 16:23:19 user nova-compute[73627]:     </interface>
Aug 26 16:23:19 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:23:19 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/console.log" append="off"/>
Aug 26 16:23:19 user nova-compute[73627]:     </serial>
Aug 26 16:23:19 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:23:19 user nova-compute[73627]:     <video>
Aug 26 16:23:19 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:19 user nova-compute[73627]:     </video>
Aug 26 16:23:19 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:23:19 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:23:19 user nova-compute[73627]:     </rng>
Aug 26 16:23:19 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:23:19 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:23:19 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:23:19 user nova-compute[73627]:     </memballoon>
Aug 26 16:23:19 user nova-compute[73627]:   </devices>
Aug 26 16:23:19 user nova-compute[73627]: </domain>
Aug 26 16:23:19 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-167969385',display_name='tempest-ServerRescueNegativeTestJSON-server-167969385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-167969385',id=4,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-atgh31tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:11Z,user_data=None,user_id='acdf029015a64f89aa51e6559e0f962c',uuid=a6f68ea4-789d-4456-a82d-d067384b566b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:c3,bridge_name='br-int',has_traffic_filtering=True,id=afd1a924-cb15-439a-b687-1dde16f591d5,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd1a924-cb') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG os_vif [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:c3,bridge_name='br-int',has_traffic_filtering=True,id=afd1a924-cb15-439a-b687-1dde16f591d5,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd1a924-cb') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:23:19 user sudo[82983]: pam_unix(sudo:session): session closed for user root
Aug 26 16:23:19 user nova-compute[73627]: INFO oslo.privsep.daemon [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Spawned new privsep daemon via rootwrap
Aug 26 16:23:19 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 16:23:19 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 16:23:19 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 26 16:23:19 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82988
Aug 26 16:23:19 user nova-compute[73627]: WARNING oslo_privsep.priv_context [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] privsep daemon already running
Aug 26 16:23:19 user nova-compute[73627]: WARNING oslo_privsep.priv_context [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] privsep daemon already running
Aug 26 16:23:19 user nova-compute[73627]: WARNING oslo_privsep.priv_context [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] privsep daemon already running
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.network.neutron [req-cf059324-7be2-4e6d-bbd3-828c1247277a req-f30e8759-5efb-4663-93e4-0e0d3d51845f service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Updated VIF entry in instance network info cache for port 241ea534-a7ce-437b-9e82-8ed8ffe61c09. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG nova.network.neutron [req-cf059324-7be2-4e6d-bbd3-828c1247277a req-f30e8759-5efb-4663-93e4-0e0d3d51845f service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Updating instance_info_cache with network_info: [{"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cf059324-7be2-4e6d-bbd3-828c1247277a req-f30e8759-5efb-4663-93e4-0e0d3d51845f service nova] Releasing lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-a55db962-713a-4c46-b981-ee24a49e47f7 req-58767a71-0fda-44c9-8564-9aa777b159c7 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updated VIF entry in instance network info cache for port 7b801568-1011-4cc6-8a1b-b15d44abf741. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-a55db962-713a-4c46-b981-ee24a49e47f7 req-58767a71-0fda-44c9-8564-9aa777b159c7 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updating instance_info_cache with network_info: [{"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c56301a-0659-47ee-9bdc-dcdb25229bb2 req-58663694-faa4-4ccd-96b4-8aed2d814ae2 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Updated VIF entry in instance network info cache for port 4905f341-d7d6-47da-b6b2-1dd43d93133d. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c56301a-0659-47ee-9bdc-dcdb25229bb2 req-58663694-faa4-4ccd-96b4-8aed2d814ae2 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Updating instance_info_cache with network_info: [{"id": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "address": "fa:16:3e:14:39:70", "network": {"id": "1a393b72-2045-4ad2-b823-8dd0a0239bf5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2041643108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43cbe040c162469897bb683eeff4d543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4905f341-d7", "ovs_interfaceid": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a55db962-713a-4c46-b981-ee24a49e47f7 req-58767a71-0fda-44c9-8564-9aa777b159c7 service nova] Releasing lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b801568-10, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b801568-10, col_values=(('external_ids', {'iface-id': '7b801568-1011-4cc6-8a1b-b15d44abf741', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:0b:2d', 'vm-uuid': '6907d670-3efe-473c-b03c-eb26c4b7ef4e'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c56301a-0659-47ee-9bdc-dcdb25229bb2 req-58663694-faa4-4ccd-96b4-8aed2d814ae2 service nova] Releasing lock "refresh_cache-09d293f0-0c31-4d11-8ba3-b6e2e4881c42" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:20 user nova-compute[73627]: INFO os_vif [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:0b:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b801568-1011-4cc6-8a1b-b15d44abf741,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b801568-10')
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafd1a924-cb, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapafd1a924-cb, col_values=(('external_ids', {'iface-id': 'afd1a924-cb15-439a-b687-1dde16f591d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:b1:c3', 'vm-uuid': 'a6f68ea4-789d-4456-a82d-d067384b566b'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: INFO os_vif [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:c3,bridge_name='br-int',has_traffic_filtering=True,id=afd1a924-cb15-439a-b687-1dde16f591d5,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd1a924-cb')
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4905f341-d7, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4905f341-d7, col_values=(('external_ids', {'iface-id': '4905f341-d7d6-47da-b6b2-1dd43d93133d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:39:70', 'vm-uuid': '09d293f0-0c31-4d11-8ba3-b6e2e4881c42'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: INFO os_vif [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:39:70,bridge_name='br-int',has_traffic_filtering=True,id=4905f341-d7d6-47da-b6b2-1dd43d93133d,network=Network(1a393b72-2045-4ad2-b823-8dd0a0239bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4905f341-d7')
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap241ea534-a7, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap241ea534-a7, col_values=(('external_ids', {'iface-id': '241ea534-a7ce-437b-9e82-8ed8ffe61c09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:fa:c8', 'vm-uuid': '8164bb99-842e-49fc-8f36-093de455c311'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No VIF found with MAC fa:16:3e:92:0b:2d, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:20 user nova-compute[73627]: INFO os_vif [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fa:c8,bridge_name='br-int',has_traffic_filtering=True,id=241ea534-a7ce-437b-9e82-8ed8ffe61c09,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241ea534-a7')
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No VIF found with MAC fa:16:3e:89:b1:c3, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] No VIF found with MAC fa:16:3e:14:39:70, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:23:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] No VIF found with MAC fa:16:3e:d2:fa:c8, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:23:21 user nova-compute[73627]: INFO nova.compute.claims [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Claim successful on node user
Aug 26 16:23:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-9f6e9309-e331-435d-9925-a89f54475b17 req-0fe55a9e-0b2b-40ae-853c-bc58732cfebc service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Updated VIF entry in instance network info cache for port afd1a924-cb15-439a-b687-1dde16f591d5. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-9f6e9309-e331-435d-9925-a89f54475b17 req-0fe55a9e-0b2b-40ae-853c-bc58732cfebc service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Updating instance_info_cache with network_info: [{"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9f6e9309-e331-435d-9925-a89f54475b17 req-0fe55a9e-0b2b-40ae-853c-bc58732cfebc service nova] Releasing lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:23:21 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:23:21 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:23:21 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:23:22 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Creating image(s)
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "/opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "/opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG nova.policy [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd643e68350c749df9a033c5ee9bae19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78924631c2e241b0b0c5cb8c9c24b4a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.172s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.160s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk 1073741824" returned: 0 in 0.050s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.151s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Cannot resize image /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Ensure instance console log exists: /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:25 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Successfully created port: 7b47c648-cab6-43bb-bae0-85a3690cb4ea {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:23:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067008.5921986, 6907d670-3efe-473c-b03c-eb26c4b7ef4e => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:28 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] VM Resumed (Lifecycle Event)
Aug 26 16:23:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:23:28 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Instance spawned successfully.
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:23:28 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Instance spawned successfully.
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:28 user nova-compute[73627]: INFO nova.compute.manager [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Took 18.60 seconds to spawn the instance on the hypervisor.
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:28 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067008.6279624, 6907d670-3efe-473c-b03c-eb26c4b7ef4e => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:28 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] VM Started (Lifecycle Event)
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Successfully updated port: 7b47c648-cab6-43bb-bae0-85a3690cb4ea {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:23:28 user nova-compute[73627]: INFO nova.compute.manager [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Took 19.85 seconds to spawn the instance on the hypervisor.
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquired lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:28 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Instance spawned successfully.
Aug 26 16:23:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067008.6292713, 8164bb99-842e-49fc-8f36-093de455c311 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] VM Resumed (Lifecycle Event)
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Instance spawned successfully.
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-cbf6a7cb-72f8-425a-ae02-431882e8595d req-52a3e13e-e21b-4292-90f1-6c3c8635a9f5 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Received event network-changed-7b47c648-cab6-43bb-bae0-85a3690cb4ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-cbf6a7cb-72f8-425a-ae02-431882e8595d req-52a3e13e-e21b-4292-90f1-6c3c8635a9f5 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Refreshing instance network info cache due to event network-changed-7b47c648-cab6-43bb-bae0-85a3690cb4ea. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cbf6a7cb-72f8-425a-ae02-431882e8595d req-52a3e13e-e21b-4292-90f1-6c3c8635a9f5 service nova] Acquiring lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Took 21.52 seconds to build instance.
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Took 20.19 seconds to build instance.
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-baca9abd-998c-4612-8554-908b3cec450d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "8164bb99-842e-49fc-8f36-093de455c311" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.727s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bbb5b91d-caab-451b-9b36-4aa090f1bd71 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.371s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Took 21.45 seconds to spawn the instance on the hypervisor.
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067008.642005, 8164bb99-842e-49fc-8f36-093de455c311 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] VM Started (Lifecycle Event)
Aug 26 16:23:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Took 18.12 seconds to spawn the instance on the hypervisor.
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067008.9218466, a6f68ea4-789d-4456-a82d-d067384b566b => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] VM Resumed (Lifecycle Event)
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Took 19.29 seconds to build instance.
Aug 26 16:23:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6dcdcbf4-21ed-47a1-aba5-1d812bec0e15 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "a6f68ea4-789d-4456-a82d-d067384b566b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.462s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Took 22.72 seconds to build instance.
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067008.9229517, a6f68ea4-789d-4456-a82d-d067384b566b => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] VM Started (Lifecycle Event)
Aug 26 16:23:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a815c460-4639-4ad8-9f60-703adedd8a0c tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.979s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:29 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067009.1672685, 09d293f0-0c31-4d11-8ba3-b6e2e4881c42 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:29 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] VM Resumed (Lifecycle Event)
Aug 26 16:23:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:30 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067009.1696997, 09d293f0-0c31-4d11-8ba3-b6e2e4881c42 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:30 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] VM Started (Lifecycle Event)
Aug 26 16:23:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:30 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Updating instance_info_cache with network_info: [{"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Releasing lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Instance network_info: |[{"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:23:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cbf6a7cb-72f8-425a-ae02-431882e8595d req-52a3e13e-e21b-4292-90f1-6c3c8635a9f5 service nova] Acquired lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:30 user nova-compute[73627]: DEBUG nova.network.neutron [req-cbf6a7cb-72f8-425a-ae02-431882e8595d req-52a3e13e-e21b-4292-90f1-6c3c8635a9f5 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Refreshing network info cache for port 7b47c648-cab6-43bb-bae0-85a3690cb4ea {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Start _get_guest_xml network_info=[{"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:23:31 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:31 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-168422289',display_name='tempest-AttachVolumeNegativeTest-server-168422289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-168422289',id=5,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTtrofWIbDkH09OMaX8ym0HDKfTOcV6N7I8fHHzHEv3eBxj6JlGPkmN8N5nJE3v0lSV2D4lAyo2ZhMVwgCHygQ1vCVqUhrrey2QM45upU76aSS8JKcqy6ooquNU411XwA==',key_name='tempest-keypair-1244461462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-mzmsxl11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=eb7bd725-fdaa-46cf-aaa0-8430066c6fd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:33:ba,bridge_name='br-int',has_traffic_filtering=True,id=7b47c648-cab6-43bb-bae0-85a3690cb4ea,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b47c648-ca') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'pci_devices' on Instance uuid eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:23:31 user nova-compute[73627]:   <uuid>eb7bd725-fdaa-46cf-aaa0-8430066c6fd3</uuid>
Aug 26 16:23:31 user nova-compute[73627]:   <name>instance-00000005</name>
Aug 26 16:23:31 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:23:31 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:23:31 user nova-compute[73627]:   <metadata>
Aug 26 16:23:31 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:23:31 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:23:31 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeNegativeTest-server-168422289</nova:name>
Aug 26 16:23:31 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:23:31</nova:creationTime>
Aug 26 16:23:31 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:23:31 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:23:31 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:23:31 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:23:31 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:23:31 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:23:31 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:23:31 user nova-compute[73627]:       <nova:owner>
Aug 26 16:23:31 user nova-compute[73627]:         <nova:user uuid="d643e68350c749df9a033c5ee9bae19f">tempest-AttachVolumeNegativeTest-1218878917-project-member</nova:user>
Aug 26 16:23:31 user nova-compute[73627]:         <nova:project uuid="78924631c2e241b0b0c5cb8c9c24b4a4">tempest-AttachVolumeNegativeTest-1218878917</nova:project>
Aug 26 16:23:31 user nova-compute[73627]:       </nova:owner>
Aug 26 16:23:31 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:23:31 user nova-compute[73627]:       <nova:ports>
Aug 26 16:23:31 user nova-compute[73627]:         <nova:port uuid="7b47c648-cab6-43bb-bae0-85a3690cb4ea">
Aug 26 16:23:31 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 16:23:31 user nova-compute[73627]:         </nova:port>
Aug 26 16:23:31 user nova-compute[73627]:       </nova:ports>
Aug 26 16:23:31 user nova-compute[73627]:     </nova:instance>
Aug 26 16:23:31 user nova-compute[73627]:   </metadata>
Aug 26 16:23:31 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:23:31 user nova-compute[73627]:     <system>
Aug 26 16:23:31 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:23:31 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:23:31 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:23:31 user nova-compute[73627]:       <entry name="serial">eb7bd725-fdaa-46cf-aaa0-8430066c6fd3</entry>
Aug 26 16:23:31 user nova-compute[73627]:       <entry name="uuid">eb7bd725-fdaa-46cf-aaa0-8430066c6fd3</entry>
Aug 26 16:23:31 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:23:31 user nova-compute[73627]:     </system>
Aug 26 16:23:31 user nova-compute[73627]:   </sysinfo>
Aug 26 16:23:31 user nova-compute[73627]:   <os>
Aug 26 16:23:31 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:23:31 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:23:31 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:23:31 user nova-compute[73627]:   </os>
Aug 26 16:23:31 user nova-compute[73627]:   <features>
Aug 26 16:23:31 user nova-compute[73627]:     <acpi/>
Aug 26 16:23:31 user nova-compute[73627]:     <apic/>
Aug 26 16:23:31 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:23:31 user nova-compute[73627]:   </features>
Aug 26 16:23:31 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:23:31 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:23:31 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:23:31 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:23:31 user nova-compute[73627]:   </clock>
Aug 26 16:23:31 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:23:31 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:23:31 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:23:31 user nova-compute[73627]:   </cpu>
Aug 26 16:23:31 user nova-compute[73627]:   <devices>
Aug 26 16:23:31 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:23:31 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:23:31 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk"/>
Aug 26 16:23:31 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:23:31 user nova-compute[73627]:     </disk>
Aug 26 16:23:31 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:23:31 user nova-compute[73627]:       <mac address="fa:16:3e:67:33:ba"/>
Aug 26 16:23:31 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:31 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:23:31 user nova-compute[73627]:       <target dev="tap7b47c648-ca"/>
Aug 26 16:23:31 user nova-compute[73627]:     </interface>
Aug 26 16:23:31 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:23:31 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/console.log" append="off"/>
Aug 26 16:23:31 user nova-compute[73627]:     </serial>
Aug 26 16:23:31 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:23:31 user nova-compute[73627]:     <video>
Aug 26 16:23:31 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:31 user nova-compute[73627]:     </video>
Aug 26 16:23:31 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:23:31 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:23:31 user nova-compute[73627]:     </rng>
Aug 26 16:23:31 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:23:31 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:23:31 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:23:31 user nova-compute[73627]:     </memballoon>
Aug 26 16:23:31 user nova-compute[73627]:   </devices>
Aug 26 16:23:31 user nova-compute[73627]: </domain>
Aug 26 16:23:31 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-168422289',display_name='tempest-AttachVolumeNegativeTest-server-168422289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-168422289',id=5,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTtrofWIbDkH09OMaX8ym0HDKfTOcV6N7I8fHHzHEv3eBxj6JlGPkmN8N5nJE3v0lSV2D4lAyo2ZhMVwgCHygQ1vCVqUhrrey2QM45upU76aSS8JKcqy6ooquNU411XwA==',key_name='tempest-keypair-1244461462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-mzmsxl11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=eb7bd725-fdaa-46cf-aaa0-8430066c6fd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:33:ba,bridge_name='br-int',has_traffic_filtering=True,id=7b47c648-cab6-43bb-bae0-85a3690cb4ea,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b47c648-ca') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG os_vif [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:33:ba,bridge_name='br-int',has_traffic_filtering=True,id=7b47c648-cab6-43bb-bae0-85a3690cb4ea,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b47c648-ca') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b47c648-ca, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b47c648-ca, col_values=(('external_ids', {'iface-id': '7b47c648-cab6-43bb-bae0-85a3690cb4ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:33:ba', 'vm-uuid': 'eb7bd725-fdaa-46cf-aaa0-8430066c6fd3'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:31 user nova-compute[73627]: INFO os_vif [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:33:ba,bridge_name='br-int',has_traffic_filtering=True,id=7b47c648-cab6-43bb-bae0-85a3690cb4ea,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b47c648-ca')
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:23:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No VIF found with MAC fa:16:3e:67:33:ba, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:23:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:33 user nova-compute[73627]: DEBUG nova.network.neutron [req-cbf6a7cb-72f8-425a-ae02-431882e8595d req-52a3e13e-e21b-4292-90f1-6c3c8635a9f5 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Updated VIF entry in instance network info cache for port 7b47c648-cab6-43bb-bae0-85a3690cb4ea. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:23:33 user nova-compute[73627]: DEBUG nova.network.neutron [req-cbf6a7cb-72f8-425a-ae02-431882e8595d req-52a3e13e-e21b-4292-90f1-6c3c8635a9f5 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Updating instance_info_cache with network_info: [{"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cbf6a7cb-72f8-425a-ae02-431882e8595d req-52a3e13e-e21b-4292-90f1-6c3c8635a9f5 service nova] Releasing lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067016.5385318, eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] VM Resumed (Lifecycle Event)
Aug 26 16:23:36 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Instance spawned successfully.
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067016.5386496, eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] VM Started (Lifecycle Event)
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:23:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:23:37 user nova-compute[73627]: INFO nova.compute.claims [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Claim successful on node user
Aug 26 16:23:37 user nova-compute[73627]: INFO nova.compute.manager [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Took 15.03 seconds to spawn the instance on the hypervisor.
Aug 26 16:23:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:37 user nova-compute[73627]: INFO nova.compute.manager [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Took 15.97 seconds to build instance.
Aug 26 16:23:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b8a67aa1-f954-498d-8104-9b1c048ff31e tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.137s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.921s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.169s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:37 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:23:37 user nova-compute[73627]: INFO nova.compute.claims [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Claim successful on node user
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:23:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.policy [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46cb037a25de4d47b21fe34498409ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db772b720283431e97eb7ccbd346884d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:23:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Creating image(s)
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "/opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "/opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "/opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.218s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.208s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG nova.policy [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '694c2459399747a68473234d3c41d24e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd458207e23cf4a2384c64470098cd200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk 1073741824" returned: 0 in 0.148s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:23:39 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Creating image(s)
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "/opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "/opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "/opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "759b806139aa94d76587484ba9b76ef5b1989513" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "759b806139aa94d76587484ba9b76ef5b1989513" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513.part --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.682s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513.part --force-share --output=json" returned: 0 in 0.233s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG nova.virt.images [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] 07e39b91-2604-443e-b035-b8b374212bf2 was qcow2, converting to raw {{(pid=73627) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513.part /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513.converted {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Cannot resize image /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Ensure instance console log exists: /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513.part /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513.converted" returned: 0 in 0.289s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513.converted --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513.converted --force-share --output=json" returned: 0 in 0.279s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "759b806139aa94d76587484ba9b76ef5b1989513" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.366s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513 --force-share --output=json" returned: 0 in 0.330s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "759b806139aa94d76587484ba9b76ef5b1989513" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "759b806139aa94d76587484ba9b76ef5b1989513" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:40 user nova-compute[73627]: DEBUG nova.network.neutron [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Successfully created port: e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Successfully created port: 8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513 --force-share --output=json" returned: 0 in 0.412s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513,backing_fmt=raw /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513,backing_fmt=raw /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk 1073741824" returned: 0 in 0.071s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "759b806139aa94d76587484ba9b76ef5b1989513" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.491s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513 --force-share --output=json" returned: 0 in 0.239s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Cannot resize image /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Ensure instance console log exists: /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:42 user nova-compute[73627]: DEBUG nova.network.neutron [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Successfully updated port: e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:23:42 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Successfully updated port: 8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:23:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquired lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:42 user nova-compute[73627]: DEBUG nova.network.neutron [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:23:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "refresh_cache-401459e7-47f6-466a-847f-01c92022bb56" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquired lock "refresh_cache-401459e7-47f6-466a-847f-01c92022bb56" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:42 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:23:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-77232990-e29e-43af-af24-64e0317d8b6a req-75c7e8ea-de8e-40ce-99ef-4b9b9bcdca22 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Received event network-changed-e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-77232990-e29e-43af-af24-64e0317d8b6a req-75c7e8ea-de8e-40ce-99ef-4b9b9bcdca22 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Refreshing instance network info cache due to event network-changed-e70e03b5-2564-4008-b416-306d76ad521c. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:23:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-77232990-e29e-43af-af24-64e0317d8b6a req-75c7e8ea-de8e-40ce-99ef-4b9b9bcdca22 service nova] Acquiring lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.neutron [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Updating instance_info_cache with network_info: [{"id": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "address": "fa:16:3e:3f:e1:88", "network": {"id": "90399b68-638c-4049-a4be-633201cdae4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-176014943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d458207e23cf4a2384c64470098cd200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8460694d-a0", "ovs_interfaceid": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Releasing lock "refresh_cache-401459e7-47f6-466a-847f-01c92022bb56" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Instance network_info: |[{"id": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "address": "fa:16:3e:3f:e1:88", "network": {"id": "90399b68-638c-4049-a4be-633201cdae4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-176014943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d458207e23cf4a2384c64470098cd200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8460694d-a0", "ovs_interfaceid": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Start _get_guest_xml network_info=[{"id": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "address": "fa:16:3e:3f:e1:88", "network": {"id": "90399b68-638c-4049-a4be-633201cdae4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-176014943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d458207e23cf4a2384c64470098cd200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8460694d-a0", "ovs_interfaceid": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:23:24Z,direct_url=<?>,disk_format='qcow2',id=07e39b91-2604-443e-b035-b8b374212bf2,min_disk=0,min_ram=0,name='',owner='136ff6f3597942a3bdb190154d6ce8d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:23:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/sda', 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '07e39b91-2604-443e-b035-b8b374212bf2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:23:43 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:43 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:23:24Z,direct_url=<?>,disk_format='qcow2',id=07e39b91-2604-443e-b035-b8b374212bf2,min_disk=0,min_ram=0,name='',owner='136ff6f3597942a3bdb190154d6ce8d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:23:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-617912877',display_name='tempest-AttachSCSIVolumeTestJSON-server-617912877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-617912877',id=7,image_ref='07e39b91-2604-443e-b035-b8b374212bf2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/Tc0Kb6xOrYkdhJ7JIfPcSvFv4fmD91BBKlV+qGMdI2O4IKYwggpJpYlHb23YSJUEYLlkfIT7WLA50MtzESFTJL6iXmYa3yE0RG3GpqGnBMDG2ojob3+blzTVBln4AvQ==',key_name='tempest-keypair-947301850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d458207e23cf4a2384c64470098cd200',ramdisk_id='',reservation_id='r-q88ohuf8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='07e39b91-2604-443e-b035-b8b374212bf2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2114073205',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2114073205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='694c2459399747a68473234d3c41d24e',uuid=401459e7-47f6-466a-847f-01c92022bb56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "address": "fa:16:3e:3f:e1:88", "network": {"id": "90399b68-638c-4049-a4be-633201cdae4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-176014943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d458207e23cf4a2384c64470098cd200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8460694d-a0", "ovs_interfaceid": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Converting VIF {"id": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "address": "fa:16:3e:3f:e1:88", "network": {"id": "90399b68-638c-4049-a4be-633201cdae4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-176014943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d458207e23cf4a2384c64470098cd200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8460694d-a0", "ovs_interfaceid": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=8460694d-a04c-490a-99d0-2c84dac1ecb2,network=Network(90399b68-638c-4049-a4be-633201cdae4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8460694d-a0') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lazy-loading 'pci_devices' on Instance uuid 401459e7-47f6-466a-847f-01c92022bb56 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.neutron [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Updating instance_info_cache with network_info: [{"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:23:43 user nova-compute[73627]:   <uuid>401459e7-47f6-466a-847f-01c92022bb56</uuid>
Aug 26 16:23:43 user nova-compute[73627]:   <name>instance-00000007</name>
Aug 26 16:23:43 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:23:43 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:23:43 user nova-compute[73627]:   <metadata>
Aug 26 16:23:43 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:23:43 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-617912877</nova:name>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:23:43</nova:creationTime>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:23:43 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:23:43 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:owner>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:user uuid="694c2459399747a68473234d3c41d24e">tempest-AttachSCSIVolumeTestJSON-2114073205-project-member</nova:user>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:project uuid="d458207e23cf4a2384c64470098cd200">tempest-AttachSCSIVolumeTestJSON-2114073205</nova:project>
Aug 26 16:23:43 user nova-compute[73627]:       </nova:owner>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:root type="image" uuid="07e39b91-2604-443e-b035-b8b374212bf2"/>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:ports>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:port uuid="8460694d-a04c-490a-99d0-2c84dac1ecb2">
Aug 26 16:23:43 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 16:23:43 user nova-compute[73627]:         </nova:port>
Aug 26 16:23:43 user nova-compute[73627]:       </nova:ports>
Aug 26 16:23:43 user nova-compute[73627]:     </nova:instance>
Aug 26 16:23:43 user nova-compute[73627]:   </metadata>
Aug 26 16:23:43 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:23:43 user nova-compute[73627]:     <system>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="serial">401459e7-47f6-466a-847f-01c92022bb56</entry>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="uuid">401459e7-47f6-466a-847f-01c92022bb56</entry>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:23:43 user nova-compute[73627]:     </system>
Aug 26 16:23:43 user nova-compute[73627]:   </sysinfo>
Aug 26 16:23:43 user nova-compute[73627]:   <os>
Aug 26 16:23:43 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:23:43 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:23:43 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:23:43 user nova-compute[73627]:   </os>
Aug 26 16:23:43 user nova-compute[73627]:   <features>
Aug 26 16:23:43 user nova-compute[73627]:     <acpi/>
Aug 26 16:23:43 user nova-compute[73627]:     <apic/>
Aug 26 16:23:43 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:23:43 user nova-compute[73627]:   </features>
Aug 26 16:23:43 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:23:43 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:23:43 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:23:43 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:23:43 user nova-compute[73627]:   </clock>
Aug 26 16:23:43 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:23:43 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:23:43 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:23:43 user nova-compute[73627]:   </cpu>
Aug 26 16:23:43 user nova-compute[73627]:   <devices>
Aug 26 16:23:43 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:23:43 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:23:43 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk"/>
Aug 26 16:23:43 user nova-compute[73627]:       <target dev="sda" bus="scsi"/>
Aug 26 16:23:43 user nova-compute[73627]:       <address type="drive" controller="0" unit="0"/>
Aug 26 16:23:43 user nova-compute[73627]:     </disk>
Aug 26 16:23:43 user nova-compute[73627]:     <disk type="file" device="cdrom">
Aug 26 16:23:43 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 16:23:43 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk.config"/>
Aug 26 16:23:43 user nova-compute[73627]:       <target dev="sdb" bus="scsi"/>
Aug 26 16:23:43 user nova-compute[73627]:       <address type="drive" controller="0" unit="1"/>
Aug 26 16:23:43 user nova-compute[73627]:     </disk>
Aug 26 16:23:43 user nova-compute[73627]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 26 16:23:43 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:23:43 user nova-compute[73627]:       <mac address="fa:16:3e:3f:e1:88"/>
Aug 26 16:23:43 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:43 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:23:43 user nova-compute[73627]:       <target dev="tap8460694d-a0"/>
Aug 26 16:23:43 user nova-compute[73627]:     </interface>
Aug 26 16:23:43 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:23:43 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/console.log" append="off"/>
Aug 26 16:23:43 user nova-compute[73627]:     </serial>
Aug 26 16:23:43 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:23:43 user nova-compute[73627]:     <video>
Aug 26 16:23:43 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:43 user nova-compute[73627]:     </video>
Aug 26 16:23:43 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:23:43 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:23:43 user nova-compute[73627]:     </rng>
Aug 26 16:23:43 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:23:43 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:23:43 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:23:43 user nova-compute[73627]:     </memballoon>
Aug 26 16:23:43 user nova-compute[73627]:   </devices>
Aug 26 16:23:43 user nova-compute[73627]: </domain>
Aug 26 16:23:43 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-617912877',display_name='tempest-AttachSCSIVolumeTestJSON-server-617912877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-617912877',id=7,image_ref='07e39b91-2604-443e-b035-b8b374212bf2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/Tc0Kb6xOrYkdhJ7JIfPcSvFv4fmD91BBKlV+qGMdI2O4IKYwggpJpYlHb23YSJUEYLlkfIT7WLA50MtzESFTJL6iXmYa3yE0RG3GpqGnBMDG2ojob3+blzTVBln4AvQ==',key_name='tempest-keypair-947301850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d458207e23cf4a2384c64470098cd200',ramdisk_id='',reservation_id='r-q88ohuf8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='07e39b91-2604-443e-b035-b8b374212bf2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2114073205',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2114073205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='694c2459399747a68473234d3c41d24e',uuid=401459e7-47f6-466a-847f-01c92022bb56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "address": "fa:16:3e:3f:e1:88", "network": {"id": "90399b68-638c-4049-a4be-633201cdae4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-176014943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d458207e23cf4a2384c64470098cd200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8460694d-a0", "ovs_interfaceid": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Converting VIF {"id": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "address": "fa:16:3e:3f:e1:88", "network": {"id": "90399b68-638c-4049-a4be-633201cdae4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-176014943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d458207e23cf4a2384c64470098cd200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8460694d-a0", "ovs_interfaceid": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=8460694d-a04c-490a-99d0-2c84dac1ecb2,network=Network(90399b68-638c-4049-a4be-633201cdae4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8460694d-a0') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG os_vif [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=8460694d-a04c-490a-99d0-2c84dac1ecb2,network=Network(90399b68-638c-4049-a4be-633201cdae4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8460694d-a0') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Releasing lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Instance network_info: |[{"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-77232990-e29e-43af-af24-64e0317d8b6a req-75c7e8ea-de8e-40ce-99ef-4b9b9bcdca22 service nova] Acquired lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.neutron [req-77232990-e29e-43af-af24-64e0317d8b6a req-75c7e8ea-de8e-40ce-99ef-4b9b9bcdca22 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Refreshing network info cache for port e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Start _get_guest_xml network_info=[{"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8460694d-a0, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8460694d-a0, col_values=(('external_ids', {'iface-id': '8460694d-a04c-490a-99d0-2c84dac1ecb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:e1:88', 'vm-uuid': '401459e7-47f6-466a-847f-01c92022bb56'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:43 user nova-compute[73627]: INFO os_vif [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=8460694d-a04c-490a-99d0-2c84dac1ecb2,network=Network(90399b68-638c-4049-a4be-633201cdae4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8460694d-a0')
Aug 26 16:23:43 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:43 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1772519798',display_name='tempest-VolumesAdminNegativeTest-server-1772519798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1772519798',id=6,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqiKdM0+5Ods/ywUBEA055o/xK2DR1uCp/jTxgI8IFHWDyljelMA0exdEUAh/gSjHZ6aVyiTIE8I3AePL859Ug9UdtcAPAI1c+Z2vmAudah551exQ/4mE/+tWq8MS7rRw==',key_name='tempest-keypair-605993154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db772b720283431e97eb7ccbd346884d',ramdisk_id='',reservation_id='r-3lg72hfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-8811083',owner_user_name='tempest-VolumesAdminNegativeTest-8811083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46cb037a25de4d47b21fe34498409ad7',uuid=19fcf882-d14e-4478-aed6-5e30db7d3e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converting VIF {"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=e70e03b5-2564-4008-b416-306d76ad521c,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70e03b5-25') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.objects.instance [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lazy-loading 'pci_devices' on Instance uuid 19fcf882-d14e-4478-aed6-5e30db7d3e33 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:23:43 user nova-compute[73627]:   <uuid>19fcf882-d14e-4478-aed6-5e30db7d3e33</uuid>
Aug 26 16:23:43 user nova-compute[73627]:   <name>instance-00000006</name>
Aug 26 16:23:43 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:23:43 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:23:43 user nova-compute[73627]:   <metadata>
Aug 26 16:23:43 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:23:43 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1772519798</nova:name>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:23:43</nova:creationTime>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:23:43 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:23:43 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:owner>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:user uuid="46cb037a25de4d47b21fe34498409ad7">tempest-VolumesAdminNegativeTest-8811083-project-member</nova:user>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:project uuid="db772b720283431e97eb7ccbd346884d">tempest-VolumesAdminNegativeTest-8811083</nova:project>
Aug 26 16:23:43 user nova-compute[73627]:       </nova:owner>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:23:43 user nova-compute[73627]:       <nova:ports>
Aug 26 16:23:43 user nova-compute[73627]:         <nova:port uuid="e70e03b5-2564-4008-b416-306d76ad521c">
Aug 26 16:23:43 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 16:23:43 user nova-compute[73627]:         </nova:port>
Aug 26 16:23:43 user nova-compute[73627]:       </nova:ports>
Aug 26 16:23:43 user nova-compute[73627]:     </nova:instance>
Aug 26 16:23:43 user nova-compute[73627]:   </metadata>
Aug 26 16:23:43 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:23:43 user nova-compute[73627]:     <system>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="serial">19fcf882-d14e-4478-aed6-5e30db7d3e33</entry>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="uuid">19fcf882-d14e-4478-aed6-5e30db7d3e33</entry>
Aug 26 16:23:43 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:23:43 user nova-compute[73627]:     </system>
Aug 26 16:23:43 user nova-compute[73627]:   </sysinfo>
Aug 26 16:23:43 user nova-compute[73627]:   <os>
Aug 26 16:23:43 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:23:43 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:23:43 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:23:43 user nova-compute[73627]:   </os>
Aug 26 16:23:43 user nova-compute[73627]:   <features>
Aug 26 16:23:43 user nova-compute[73627]:     <acpi/>
Aug 26 16:23:43 user nova-compute[73627]:     <apic/>
Aug 26 16:23:43 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:23:43 user nova-compute[73627]:   </features>
Aug 26 16:23:43 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:23:43 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:23:43 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:23:43 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:23:43 user nova-compute[73627]:   </clock>
Aug 26 16:23:43 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:23:43 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:23:43 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:23:43 user nova-compute[73627]:   </cpu>
Aug 26 16:23:43 user nova-compute[73627]:   <devices>
Aug 26 16:23:43 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:23:43 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:23:43 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk"/>
Aug 26 16:23:43 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:23:43 user nova-compute[73627]:     </disk>
Aug 26 16:23:43 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:23:43 user nova-compute[73627]:       <mac address="fa:16:3e:c0:cd:01"/>
Aug 26 16:23:43 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:43 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:23:43 user nova-compute[73627]:       <target dev="tape70e03b5-25"/>
Aug 26 16:23:43 user nova-compute[73627]:     </interface>
Aug 26 16:23:43 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:23:43 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/console.log" append="off"/>
Aug 26 16:23:43 user nova-compute[73627]:     </serial>
Aug 26 16:23:43 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:23:43 user nova-compute[73627]:     <video>
Aug 26 16:23:43 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:43 user nova-compute[73627]:     </video>
Aug 26 16:23:43 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:23:43 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:23:43 user nova-compute[73627]:     </rng>
Aug 26 16:23:43 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:23:43 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:23:43 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:23:43 user nova-compute[73627]:     </memballoon>
Aug 26 16:23:43 user nova-compute[73627]:   </devices>
Aug 26 16:23:43 user nova-compute[73627]: </domain>
Aug 26 16:23:43 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1772519798',display_name='tempest-VolumesAdminNegativeTest-server-1772519798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1772519798',id=6,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqiKdM0+5Ods/ywUBEA055o/xK2DR1uCp/jTxgI8IFHWDyljelMA0exdEUAh/gSjHZ6aVyiTIE8I3AePL859Ug9UdtcAPAI1c+Z2vmAudah551exQ/4mE/+tWq8MS7rRw==',key_name='tempest-keypair-605993154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db772b720283431e97eb7ccbd346884d',ramdisk_id='',reservation_id='r-3lg72hfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-8811083',owner_user_name='tempest-VolumesAdminNegativeTest-8811083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46cb037a25de4d47b21fe34498409ad7',uuid=19fcf882-d14e-4478-aed6-5e30db7d3e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:23:43 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converting VIF {"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=e70e03b5-2564-4008-b416-306d76ad521c,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70e03b5-25') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG os_vif [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=e70e03b5-2564-4008-b416-306d76ad521c,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70e03b5-25') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape70e03b5-25, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape70e03b5-25, col_values=(('external_ids', {'iface-id': 'e70e03b5-2564-4008-b416-306d76ad521c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:cd:01', 'vm-uuid': '19fcf882-d14e-4478-aed6-5e30db7d3e33'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] No BDM found with device name sda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] No VIF found with MAC fa:16:3e:3f:e1:88, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:23:44 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Using config drive
Aug 26 16:23:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:44 user nova-compute[73627]: INFO os_vif [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=e70e03b5-2564-4008-b416-306d76ad521c,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70e03b5-25')
Aug 26 16:23:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] No VIF found with MAC fa:16:3e:c0:cd:01, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:23:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:45 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Creating config drive at /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk.config
Aug 26 16:23:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr9zusi20 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:45 user nova-compute[73627]: DEBUG nova.network.neutron [req-77232990-e29e-43af-af24-64e0317d8b6a req-75c7e8ea-de8e-40ce-99ef-4b9b9bcdca22 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Updated VIF entry in instance network info cache for port e70e03b5-2564-4008-b416-306d76ad521c. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:23:45 user nova-compute[73627]: DEBUG nova.network.neutron [req-77232990-e29e-43af-af24-64e0317d8b6a req-75c7e8ea-de8e-40ce-99ef-4b9b9bcdca22 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Updating instance_info_cache with network_info: [{"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr9zusi20" returned: 0 in 0.101s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-77232990-e29e-43af-af24-64e0317d8b6a req-75c7e8ea-de8e-40ce-99ef-4b9b9bcdca22 service nova] Releasing lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-2563f78f-9d42-40a3-91fb-ef24d5c35b8d req-3368fbfa-223c-47c1-a80d-77321355d6de service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-changed-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-2563f78f-9d42-40a3-91fb-ef24d5c35b8d req-3368fbfa-223c-47c1-a80d-77321355d6de service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Refreshing instance network info cache due to event network-changed-8460694d-a04c-490a-99d0-2c84dac1ecb2. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:23:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2563f78f-9d42-40a3-91fb-ef24d5c35b8d req-3368fbfa-223c-47c1-a80d-77321355d6de service nova] Acquiring lock "refresh_cache-401459e7-47f6-466a-847f-01c92022bb56" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2563f78f-9d42-40a3-91fb-ef24d5c35b8d req-3368fbfa-223c-47c1-a80d-77321355d6de service nova] Acquired lock "refresh_cache-401459e7-47f6-466a-847f-01c92022bb56" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:45 user nova-compute[73627]: DEBUG nova.network.neutron [req-2563f78f-9d42-40a3-91fb-ef24d5c35b8d req-3368fbfa-223c-47c1-a80d-77321355d6de service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Refreshing network info cache for port 8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG nova.network.neutron [req-2563f78f-9d42-40a3-91fb-ef24d5c35b8d req-3368fbfa-223c-47c1-a80d-77321355d6de service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Updated VIF entry in instance network info cache for port 8460694d-a04c-490a-99d0-2c84dac1ecb2. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG nova.network.neutron [req-2563f78f-9d42-40a3-91fb-ef24d5c35b8d req-3368fbfa-223c-47c1-a80d-77321355d6de service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Updating instance_info_cache with network_info: [{"id": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "address": "fa:16:3e:3f:e1:88", "network": {"id": "90399b68-638c-4049-a4be-633201cdae4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-176014943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d458207e23cf4a2384c64470098cd200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8460694d-a0", "ovs_interfaceid": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2563f78f-9d42-40a3-91fb-ef24d5c35b8d req-3368fbfa-223c-47c1-a80d-77321355d6de service nova] Releasing lock "refresh_cache-401459e7-47f6-466a-847f-01c92022bb56" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-44fedaa6-ca9f-4e7f-8dba-70f4d049f1cc req-c72b2374-3c3e-4b4f-9831-09e73b5ee24c service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Received event network-vif-plugged-e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-44fedaa6-ca9f-4e7f-8dba-70f4d049f1cc req-c72b2374-3c3e-4b4f-9831-09e73b5ee24c service nova] Acquiring lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-44fedaa6-ca9f-4e7f-8dba-70f4d049f1cc req-c72b2374-3c3e-4b4f-9831-09e73b5ee24c service nova] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-44fedaa6-ca9f-4e7f-8dba-70f4d049f1cc req-c72b2374-3c3e-4b4f-9831-09e73b5ee24c service nova] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-44fedaa6-ca9f-4e7f-8dba-70f4d049f1cc req-c72b2374-3c3e-4b4f-9831-09e73b5ee24c service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] No waiting events found dispatching network-vif-plugged-e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:23:46 user nova-compute[73627]: WARNING nova.compute.manager [req-44fedaa6-ca9f-4e7f-8dba-70f4d049f1cc req-c72b2374-3c3e-4b4f-9831-09e73b5ee24c service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Received unexpected event network-vif-plugged-e70e03b5-2564-4008-b416-306d76ad521c for instance with vm_state building and task_state spawning.
Aug 26 16:23:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:23:47 user nova-compute[73627]: WARNING nova.compute.manager [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received unexpected event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with vm_state active and task_state None.
Aug 26 16:23:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:23:47 user nova-compute[73627]: WARNING nova.compute.manager [req-c3a56909-3298-4959-a0f1-0cb4dde6c7b4 req-bfae4f52-c0a8-49b0-9fb7-55ff6d6107cf service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received unexpected event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with vm_state active and task_state None.
Aug 26 16:23:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Received event network-vif-plugged-e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] Acquiring lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] No waiting events found dispatching network-vif-plugged-e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:23:48 user nova-compute[73627]: WARNING nova.compute.manager [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Received unexpected event network-vif-plugged-e70e03b5-2564-4008-b416-306d76ad521c for instance with vm_state building and task_state spawning.
Aug 26 16:23:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] No waiting events found dispatching network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:23:48 user nova-compute[73627]: WARNING nova.compute.manager [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received unexpected event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 for instance with vm_state building and task_state spawning.
Aug 26 16:23:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] No waiting events found dispatching network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:23:48 user nova-compute[73627]: WARNING nova.compute.manager [req-139089ec-99b6-4968-b246-07a0efff70ac req-8e3335ef-6d7e-4afd-8c0d-86ea238d8a81 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received unexpected event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 for instance with vm_state building and task_state spawning.
Aug 26 16:23:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067030.1909437, 19fcf882-d14e-4478-aed6-5e30db7d3e33 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] VM Resumed (Lifecycle Event)
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Instance spawned successfully.
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067030.1911733, 19fcf882-d14e-4478-aed6-5e30db7d3e33 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] VM Started (Lifecycle Event)
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Instance spawned successfully.
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.compute.manager [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Took 12.00 seconds to spawn the instance on the hypervisor.
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.compute.manager [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Took 11.40 seconds to spawn the instance on the hypervisor.
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067030.322169, 401459e7-47f6-466a-847f-01c92022bb56 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 401459e7-47f6-466a-847f-01c92022bb56] VM Resumed (Lifecycle Event)
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 401459e7-47f6-466a-847f-01c92022bb56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067030.3225796, 401459e7-47f6-466a-847f-01c92022bb56 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 401459e7-47f6-466a-847f-01c92022bb56] VM Started (Lifecycle Event)
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.compute.manager [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Took 13.68 seconds to build instance.
Aug 26 16:23:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:23:50 user nova-compute[73627]: INFO nova.compute.manager [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Took 12.91 seconds to build instance.
Aug 26 16:23:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-52bcc92a-dcdb-404d-8381-c2307f530eb3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.310s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e15ab120-34a0-4ebb-b9ee-aef019833873 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.300s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:52 user nova-compute[73627]: DEBUG nova.compute.manager [req-9693acca-d5c7-4dec-9caa-06b7aa62dad3 req-d9980c75-156a-43c1-94f8-1509b14ecd62 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Received event network-vif-plugged-7b47c648-cab6-43bb-bae0-85a3690cb4ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9693acca-d5c7-4dec-9caa-06b7aa62dad3 req-d9980c75-156a-43c1-94f8-1509b14ecd62 service nova] Acquiring lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9693acca-d5c7-4dec-9caa-06b7aa62dad3 req-d9980c75-156a-43c1-94f8-1509b14ecd62 service nova] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9693acca-d5c7-4dec-9caa-06b7aa62dad3 req-d9980c75-156a-43c1-94f8-1509b14ecd62 service nova] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:52 user nova-compute[73627]: DEBUG nova.compute.manager [req-9693acca-d5c7-4dec-9caa-06b7aa62dad3 req-d9980c75-156a-43c1-94f8-1509b14ecd62 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] No waiting events found dispatching network-vif-plugged-7b47c648-cab6-43bb-bae0-85a3690cb4ea {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:23:52 user nova-compute[73627]: WARNING nova.compute.manager [req-9693acca-d5c7-4dec-9caa-06b7aa62dad3 req-d9980c75-156a-43c1-94f8-1509b14ecd62 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Received unexpected event network-vif-plugged-7b47c648-cab6-43bb-bae0-85a3690cb4ea for instance with vm_state active and task_state None.
Aug 26 16:23:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:23:54 user nova-compute[73627]: INFO nova.compute.claims [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Claim successful on node user
Aug 26 16:23:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-2e4716c5-9422-452c-bd82-b87a498bad85 req-9ea35359-5d71-4c29-8a51-21ac2fe14024 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Received event network-vif-plugged-7b47c648-cab6-43bb-bae0-85a3690cb4ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2e4716c5-9422-452c-bd82-b87a498bad85 req-9ea35359-5d71-4c29-8a51-21ac2fe14024 service nova] Acquiring lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2e4716c5-9422-452c-bd82-b87a498bad85 req-9ea35359-5d71-4c29-8a51-21ac2fe14024 service nova] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2e4716c5-9422-452c-bd82-b87a498bad85 req-9ea35359-5d71-4c29-8a51-21ac2fe14024 service nova] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-2e4716c5-9422-452c-bd82-b87a498bad85 req-9ea35359-5d71-4c29-8a51-21ac2fe14024 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] No waiting events found dispatching network-vif-plugged-7b47c648-cab6-43bb-bae0-85a3690cb4ea {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:23:54 user nova-compute[73627]: WARNING nova.compute.manager [req-2e4716c5-9422-452c-bd82-b87a498bad85 req-9ea35359-5d71-4c29-8a51-21ac2fe14024 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Received unexpected event network-vif-plugged-7b47c648-cab6-43bb-bae0-85a3690cb4ea for instance with vm_state active and task_state None.
Aug 26 16:23:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:23:54 user nova-compute[73627]: DEBUG nova.network.neutron [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:23:54 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:23:55 user nova-compute[73627]: DEBUG nova.compute.manager [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG nova.policy [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd553291cb27f449bb89c46add55e67e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b9b0bdf908482ea1645968ddc1ba73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG nova.compute.manager [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:23:55 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Creating image(s)
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Acquiring lock "3b4253a4-1436-4026-8549-f48f1bb8f121" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.202s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:23:55 user nova-compute[73627]: INFO nova.compute.claims [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Claim successful on node user
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.270s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk 1073741824" returned: 0 in 0.086s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.244s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Cannot resize image /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Ensure instance console log exists: /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.761s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.network.neutron [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Successfully created port: a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:23:56 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.policy [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0f5d943da2c46799cd588eee9410ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ed90cd886d40f5bf932825592a5be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] There are 0 instances to clean {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73627) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:23:56 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Creating image(s)
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "/opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "/opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.241s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.275s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk 1073741824" returned: 0 in 0.061s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.224s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Cannot resize image /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Ensure instance console log exists: /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:23:57 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG nova.network.neutron [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Successfully updated port: a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Successfully created port: 7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquired lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG nova.network.neutron [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-55e2b986-14c1-4a42-8e06-c5f82ac88552 req-96d99d07-a175-4cd0-b04a-72b41b3864fd service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-changed-a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-55e2b986-14c1-4a42-8e06-c5f82ac88552 req-96d99d07-a175-4cd0-b04a-72b41b3864fd service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Refreshing instance network info cache due to event network-changed-a75b9117-9045-4d5f-8b40-028c8f498bb9. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-55e2b986-14c1-4a42-8e06-c5f82ac88552 req-96d99d07-a175-4cd0-b04a-72b41b3864fd service nova] Acquiring lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG nova.network.neutron [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:58 user nova-compute[73627]: DEBUG nova.network.neutron [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Updating instance_info_cache with network_info: [{"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Releasing lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Instance network_info: |[{"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-55e2b986-14c1-4a42-8e06-c5f82ac88552 req-96d99d07-a175-4cd0-b04a-72b41b3864fd service nova] Acquired lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.network.neutron [req-55e2b986-14c1-4a42-8e06-c5f82ac88552 req-96d99d07-a175-4cd0-b04a-72b41b3864fd service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Refreshing network info cache for port a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Start _get_guest_xml network_info=[{"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:23:59 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:59 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463194229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463194229',id=8,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Sj6yy35YwIDlvvvihzQymqFhoon7RMyC7OSNPYjzgUeKCKw+OuVT0CMoXlNszZUBa6Mj8sVK/09WRxOxBs8UryT21dkwjmnJCwl3Lu9BmupDqwjouXifLfMdb3Sz8bg==',key_name='tempest-keypair-339813193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5b9b0bdf908482ea1645968ddc1ba73',ramdisk_id='',reservation_id='r-cb6v5hvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1130913096',owner_user_name='tempest-TaggedAttachmentsTest-1130913096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d553291cb27f449bb89c46add55e67e3',uuid=7329f0f0-e851-4a58-92b6-4edc3f9ec5e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converting VIF {"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bb:ce,bridge_name='br-int',has_traffic_filtering=True,id=a75b9117-9045-4d5f-8b40-028c8f498bb9,network=Network(f2f8a669-ca79-4a20-8877-55f92defd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa75b9117-90') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.objects.instance [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lazy-loading 'pci_devices' on Instance uuid 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:23:59 user nova-compute[73627]:   <uuid>7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</uuid>
Aug 26 16:23:59 user nova-compute[73627]:   <name>instance-00000008</name>
Aug 26 16:23:59 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:23:59 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:23:59 user nova-compute[73627]:   <metadata>
Aug 26 16:23:59 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:23:59 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:23:59 user nova-compute[73627]:       <nova:name>tempest-device-tagging-server-1463194229</nova:name>
Aug 26 16:23:59 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:23:59</nova:creationTime>
Aug 26 16:23:59 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:23:59 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:23:59 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:23:59 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:23:59 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:23:59 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:23:59 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:23:59 user nova-compute[73627]:       <nova:owner>
Aug 26 16:23:59 user nova-compute[73627]:         <nova:user uuid="d553291cb27f449bb89c46add55e67e3">tempest-TaggedAttachmentsTest-1130913096-project-member</nova:user>
Aug 26 16:23:59 user nova-compute[73627]:         <nova:project uuid="f5b9b0bdf908482ea1645968ddc1ba73">tempest-TaggedAttachmentsTest-1130913096</nova:project>
Aug 26 16:23:59 user nova-compute[73627]:       </nova:owner>
Aug 26 16:23:59 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:23:59 user nova-compute[73627]:       <nova:ports>
Aug 26 16:23:59 user nova-compute[73627]:         <nova:port uuid="a75b9117-9045-4d5f-8b40-028c8f498bb9">
Aug 26 16:23:59 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 16:23:59 user nova-compute[73627]:         </nova:port>
Aug 26 16:23:59 user nova-compute[73627]:       </nova:ports>
Aug 26 16:23:59 user nova-compute[73627]:     </nova:instance>
Aug 26 16:23:59 user nova-compute[73627]:   </metadata>
Aug 26 16:23:59 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:23:59 user nova-compute[73627]:     <system>
Aug 26 16:23:59 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:23:59 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:23:59 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:23:59 user nova-compute[73627]:       <entry name="serial">7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</entry>
Aug 26 16:23:59 user nova-compute[73627]:       <entry name="uuid">7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</entry>
Aug 26 16:23:59 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:23:59 user nova-compute[73627]:     </system>
Aug 26 16:23:59 user nova-compute[73627]:   </sysinfo>
Aug 26 16:23:59 user nova-compute[73627]:   <os>
Aug 26 16:23:59 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:23:59 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:23:59 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:23:59 user nova-compute[73627]:   </os>
Aug 26 16:23:59 user nova-compute[73627]:   <features>
Aug 26 16:23:59 user nova-compute[73627]:     <acpi/>
Aug 26 16:23:59 user nova-compute[73627]:     <apic/>
Aug 26 16:23:59 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:23:59 user nova-compute[73627]:   </features>
Aug 26 16:23:59 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:23:59 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:23:59 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:23:59 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:23:59 user nova-compute[73627]:   </clock>
Aug 26 16:23:59 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:23:59 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:23:59 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:23:59 user nova-compute[73627]:   </cpu>
Aug 26 16:23:59 user nova-compute[73627]:   <devices>
Aug 26 16:23:59 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:23:59 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:23:59 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk"/>
Aug 26 16:23:59 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:23:59 user nova-compute[73627]:     </disk>
Aug 26 16:23:59 user nova-compute[73627]:     <disk type="file" device="cdrom">
Aug 26 16:23:59 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 16:23:59 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk.config"/>
Aug 26 16:23:59 user nova-compute[73627]:       <target dev="hda" bus="ide"/>
Aug 26 16:23:59 user nova-compute[73627]:     </disk>
Aug 26 16:23:59 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:23:59 user nova-compute[73627]:       <mac address="fa:16:3e:2f:bb:ce"/>
Aug 26 16:23:59 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:59 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:23:59 user nova-compute[73627]:       <target dev="tapa75b9117-90"/>
Aug 26 16:23:59 user nova-compute[73627]:     </interface>
Aug 26 16:23:59 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:23:59 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/console.log" append="off"/>
Aug 26 16:23:59 user nova-compute[73627]:     </serial>
Aug 26 16:23:59 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:23:59 user nova-compute[73627]:     <video>
Aug 26 16:23:59 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:23:59 user nova-compute[73627]:     </video>
Aug 26 16:23:59 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:23:59 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:23:59 user nova-compute[73627]:     </rng>
Aug 26 16:23:59 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:23:59 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:23:59 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:23:59 user nova-compute[73627]:     </memballoon>
Aug 26 16:23:59 user nova-compute[73627]:   </devices>
Aug 26 16:23:59 user nova-compute[73627]: </domain>
Aug 26 16:23:59 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463194229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463194229',id=8,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Sj6yy35YwIDlvvvihzQymqFhoon7RMyC7OSNPYjzgUeKCKw+OuVT0CMoXlNszZUBa6Mj8sVK/09WRxOxBs8UryT21dkwjmnJCwl3Lu9BmupDqwjouXifLfMdb3Sz8bg==',key_name='tempest-keypair-339813193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5b9b0bdf908482ea1645968ddc1ba73',ramdisk_id='',reservation_id='r-cb6v5hvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1130913096',owner_user_name='tempest-TaggedAttachmentsTest-1130913096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d553291cb27f449bb89c46add55e67e3',uuid=7329f0f0-e851-4a58-92b6-4edc3f9ec5e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converting VIF {"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bb:ce,bridge_name='br-int',has_traffic_filtering=True,id=a75b9117-9045-4d5f-8b40-028c8f498bb9,network=Network(f2f8a669-ca79-4a20-8877-55f92defd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa75b9117-90') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG os_vif [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bb:ce,bridge_name='br-int',has_traffic_filtering=True,id=a75b9117-9045-4d5f-8b40-028c8f498bb9,network=Network(f2f8a669-ca79-4a20-8877-55f92defd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa75b9117-90') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa75b9117-90, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa75b9117-90, col_values=(('external_ids', {'iface-id': 'a75b9117-9045-4d5f-8b40-028c8f498bb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:bb:ce', 'vm-uuid': '7329f0f0-e851-4a58-92b6-4edc3f9ec5e8'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:59 user nova-compute[73627]: INFO os_vif [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:bb:ce,bridge_name='br-int',has_traffic_filtering=True,id=a75b9117-9045-4d5f-8b40-028c8f498bb9,network=Network(f2f8a669-ca79-4a20-8877-55f92defd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa75b9117-90')
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] No BDM found with device name hda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] No VIF found with MAC fa:16:3e:2f:bb:ce, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:23:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Using config drive
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:23:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Creating config drive at /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk.config
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp45q4sj2i {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp45q4sj2i" returned: 0 in 0.061s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:23:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-55e2b986-14c1-4a42-8e06-c5f82ac88552 req-96d99d07-a175-4cd0-b04a-72b41b3864fd service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Updated VIF entry in instance network info cache for port a75b9117-9045-4d5f-8b40-028c8f498bb9. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-55e2b986-14c1-4a42-8e06-c5f82ac88552 req-96d99d07-a175-4cd0-b04a-72b41b3864fd service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Updating instance_info_cache with network_info: [{"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Successfully updated port: 7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-55e2b986-14c1-4a42-8e06-c5f82ac88552 req-96d99d07-a175-4cd0-b04a-72b41b3864fd service nova] Releasing lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Acquiring lock "refresh_cache-3b4253a4-1436-4026-8549-f48f1bb8f121" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Acquired lock "refresh_cache-3b4253a4-1436-4026-8549-f48f1bb8f121" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-1193c38a-176e-4d52-9ec4-bfd64c96a0e0 req-5a4c813f-b6d8-4d52-9b8e-ad244be1381b service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Received event network-changed-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-1193c38a-176e-4d52-9ec4-bfd64c96a0e0 req-5a4c813f-b6d8-4d52-9b8e-ad244be1381b service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Refreshing instance network info cache due to event network-changed-7c01107b-5db8-4c30-b7eb-179c1cfdadc1. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1193c38a-176e-4d52-9ec4-bfd64c96a0e0 req-5a4c813f-b6d8-4d52-9b8e-ad244be1381b service nova] Acquiring lock "refresh_cache-3b4253a4-1436-4026-8549-f48f1bb8f121" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-893bdd10-e557-4427-b5bd-b7484a8d129d req-97999e20-1f80-4b80-a289-f279b1e5345d service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-893bdd10-e557-4427-b5bd-b7484a8d129d req-97999e20-1f80-4b80-a289-f279b1e5345d service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-893bdd10-e557-4427-b5bd-b7484a8d129d req-97999e20-1f80-4b80-a289-f279b1e5345d service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-893bdd10-e557-4427-b5bd-b7484a8d129d req-97999e20-1f80-4b80-a289-f279b1e5345d service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-893bdd10-e557-4427-b5bd-b7484a8d129d req-97999e20-1f80-4b80-a289-f279b1e5345d service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:00 user nova-compute[73627]: WARNING nova.compute.manager [req-893bdd10-e557-4427-b5bd-b7484a8d129d req-97999e20-1f80-4b80-a289-f279b1e5345d service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received unexpected event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with vm_state active and task_state None.
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Updating instance_info_cache with network_info: [{"id": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "address": "fa:16:3e:7c:c9:53", "network": {"id": "c283b31b-dc07-4174-8354-d08d62d93df9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-305034803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ed90cd886d40f5bf932825592a5be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c01107b-5d", "ovs_interfaceid": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Releasing lock "refresh_cache-3b4253a4-1436-4026-8549-f48f1bb8f121" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Instance network_info: |[{"id": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "address": "fa:16:3e:7c:c9:53", "network": {"id": "c283b31b-dc07-4174-8354-d08d62d93df9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-305034803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ed90cd886d40f5bf932825592a5be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c01107b-5d", "ovs_interfaceid": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1193c38a-176e-4d52-9ec4-bfd64c96a0e0 req-5a4c813f-b6d8-4d52-9b8e-ad244be1381b service nova] Acquired lock "refresh_cache-3b4253a4-1436-4026-8549-f48f1bb8f121" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-1193c38a-176e-4d52-9ec4-bfd64c96a0e0 req-5a4c813f-b6d8-4d52-9b8e-ad244be1381b service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Refreshing network info cache for port 7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Start _get_guest_xml network_info=[{"id": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "address": "fa:16:3e:7c:c9:53", "network": {"id": "c283b31b-dc07-4174-8354-d08d62d93df9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-305034803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ed90cd886d40f5bf932825592a5be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c01107b-5d", "ovs_interfaceid": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:01 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:24:01 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-804320675',display_name='tempest-VolumesAssistedSnapshotsTest-server-804320675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-804320675',id=9,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHW3a4Us1ze8WEZmy7vfawXegcIItK7ctfqRgQdCBgyuRPdR6i5OgJjQ1Trm5l/qw4o2AvA+47w1SxvBlPV3nlJKesM9hpuDuB1HCjtZStw5KNtY89KyyNPKA3ngN9MBUA==',key_name='tempest-keypair-230304301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ed90cd886d40f5bf932825592a5be0',ramdisk_id='',reservation_id='r-lmjel2ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1099430394',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1099430394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0f5d943da2c46799cd588eee9410ebb',uuid=3b4253a4-1436-4026-8549-f48f1bb8f121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "address": "fa:16:3e:7c:c9:53", "network": {"id": "c283b31b-dc07-4174-8354-d08d62d93df9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-305034803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ed90cd886d40f5bf932825592a5be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c01107b-5d", "ovs_interfaceid": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Converting VIF {"id": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "address": "fa:16:3e:7c:c9:53", "network": {"id": "c283b31b-dc07-4174-8354-d08d62d93df9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-305034803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ed90cd886d40f5bf932825592a5be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c01107b-5d", "ovs_interfaceid": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c9:53,bridge_name='br-int',has_traffic_filtering=True,id=7c01107b-5db8-4c30-b7eb-179c1cfdadc1,network=Network(c283b31b-dc07-4174-8354-d08d62d93df9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c01107b-5d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b4253a4-1436-4026-8549-f48f1bb8f121 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:24:01 user nova-compute[73627]:   <uuid>3b4253a4-1436-4026-8549-f48f1bb8f121</uuid>
Aug 26 16:24:01 user nova-compute[73627]:   <name>instance-00000009</name>
Aug 26 16:24:01 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:24:01 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:24:01 user nova-compute[73627]:   <metadata>
Aug 26 16:24:01 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:24:01 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:24:01 user nova-compute[73627]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-804320675</nova:name>
Aug 26 16:24:01 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:24:01</nova:creationTime>
Aug 26 16:24:01 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:24:01 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:24:01 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:24:01 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:24:01 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:24:01 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:24:01 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:24:01 user nova-compute[73627]:       <nova:owner>
Aug 26 16:24:01 user nova-compute[73627]:         <nova:user uuid="e0f5d943da2c46799cd588eee9410ebb">tempest-VolumesAssistedSnapshotsTest-1099430394-project-member</nova:user>
Aug 26 16:24:01 user nova-compute[73627]:         <nova:project uuid="46ed90cd886d40f5bf932825592a5be0">tempest-VolumesAssistedSnapshotsTest-1099430394</nova:project>
Aug 26 16:24:01 user nova-compute[73627]:       </nova:owner>
Aug 26 16:24:01 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:24:01 user nova-compute[73627]:       <nova:ports>
Aug 26 16:24:01 user nova-compute[73627]:         <nova:port uuid="7c01107b-5db8-4c30-b7eb-179c1cfdadc1">
Aug 26 16:24:01 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 16:24:01 user nova-compute[73627]:         </nova:port>
Aug 26 16:24:01 user nova-compute[73627]:       </nova:ports>
Aug 26 16:24:01 user nova-compute[73627]:     </nova:instance>
Aug 26 16:24:01 user nova-compute[73627]:   </metadata>
Aug 26 16:24:01 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:24:01 user nova-compute[73627]:     <system>
Aug 26 16:24:01 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:24:01 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:24:01 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:24:01 user nova-compute[73627]:       <entry name="serial">3b4253a4-1436-4026-8549-f48f1bb8f121</entry>
Aug 26 16:24:01 user nova-compute[73627]:       <entry name="uuid">3b4253a4-1436-4026-8549-f48f1bb8f121</entry>
Aug 26 16:24:01 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:24:01 user nova-compute[73627]:     </system>
Aug 26 16:24:01 user nova-compute[73627]:   </sysinfo>
Aug 26 16:24:01 user nova-compute[73627]:   <os>
Aug 26 16:24:01 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:24:01 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:24:01 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:24:01 user nova-compute[73627]:   </os>
Aug 26 16:24:01 user nova-compute[73627]:   <features>
Aug 26 16:24:01 user nova-compute[73627]:     <acpi/>
Aug 26 16:24:01 user nova-compute[73627]:     <apic/>
Aug 26 16:24:01 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:24:01 user nova-compute[73627]:   </features>
Aug 26 16:24:01 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:24:01 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:24:01 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:24:01 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:24:01 user nova-compute[73627]:   </clock>
Aug 26 16:24:01 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:24:01 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:24:01 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:24:01 user nova-compute[73627]:   </cpu>
Aug 26 16:24:01 user nova-compute[73627]:   <devices>
Aug 26 16:24:01 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:24:01 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:24:01 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk"/>
Aug 26 16:24:01 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:24:01 user nova-compute[73627]:     </disk>
Aug 26 16:24:01 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:24:01 user nova-compute[73627]:       <mac address="fa:16:3e:7c:c9:53"/>
Aug 26 16:24:01 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:24:01 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:24:01 user nova-compute[73627]:       <target dev="tap7c01107b-5d"/>
Aug 26 16:24:01 user nova-compute[73627]:     </interface>
Aug 26 16:24:01 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:24:01 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/console.log" append="off"/>
Aug 26 16:24:01 user nova-compute[73627]:     </serial>
Aug 26 16:24:01 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:24:01 user nova-compute[73627]:     <video>
Aug 26 16:24:01 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:24:01 user nova-compute[73627]:     </video>
Aug 26 16:24:01 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:24:01 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:24:01 user nova-compute[73627]:     </rng>
Aug 26 16:24:01 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:24:01 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:24:01 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:24:01 user nova-compute[73627]:     </memballoon>
Aug 26 16:24:01 user nova-compute[73627]:   </devices>
Aug 26 16:24:01 user nova-compute[73627]: </domain>
Aug 26 16:24:01 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-804320675',display_name='tempest-VolumesAssistedSnapshotsTest-server-804320675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-804320675',id=9,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHW3a4Us1ze8WEZmy7vfawXegcIItK7ctfqRgQdCBgyuRPdR6i5OgJjQ1Trm5l/qw4o2AvA+47w1SxvBlPV3nlJKesM9hpuDuB1HCjtZStw5KNtY89KyyNPKA3ngN9MBUA==',key_name='tempest-keypair-230304301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ed90cd886d40f5bf932825592a5be0',ramdisk_id='',reservation_id='r-lmjel2ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1099430394',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1099430394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0f5d943da2c46799cd588eee9410ebb',uuid=3b4253a4-1436-4026-8549-f48f1bb8f121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "address": "fa:16:3e:7c:c9:53", "network": {"id": "c283b31b-dc07-4174-8354-d08d62d93df9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-305034803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ed90cd886d40f5bf932825592a5be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c01107b-5d", "ovs_interfaceid": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Converting VIF {"id": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "address": "fa:16:3e:7c:c9:53", "network": {"id": "c283b31b-dc07-4174-8354-d08d62d93df9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-305034803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ed90cd886d40f5bf932825592a5be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c01107b-5d", "ovs_interfaceid": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c9:53,bridge_name='br-int',has_traffic_filtering=True,id=7c01107b-5db8-4c30-b7eb-179c1cfdadc1,network=Network(c283b31b-dc07-4174-8354-d08d62d93df9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c01107b-5d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG os_vif [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c9:53,bridge_name='br-int',has_traffic_filtering=True,id=7c01107b-5db8-4c30-b7eb-179c1cfdadc1,network=Network(c283b31b-dc07-4174-8354-d08d62d93df9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c01107b-5d') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c01107b-5d, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c01107b-5d, col_values=(('external_ids', {'iface-id': '7c01107b-5db8-4c30-b7eb-179c1cfdadc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:c9:53', 'vm-uuid': '3b4253a4-1436-4026-8549-f48f1bb8f121'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:01 user nova-compute[73627]: INFO os_vif [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c9:53,bridge_name='br-int',has_traffic_filtering=True,id=7c01107b-5db8-4c30-b7eb-179c1cfdadc1,network=Network(c283b31b-dc07-4174-8354-d08d62d93df9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c01107b-5d')
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] No VIF found with MAC fa:16:3e:7c:c9:53, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067045.1374304, 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:24:05 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] VM Resumed (Lifecycle Event)
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-1193c38a-176e-4d52-9ec4-bfd64c96a0e0 req-5a4c813f-b6d8-4d52-9b8e-ad244be1381b service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Updated VIF entry in instance network info cache for port 7c01107b-5db8-4c30-b7eb-179c1cfdadc1. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-1193c38a-176e-4d52-9ec4-bfd64c96a0e0 req-5a4c813f-b6d8-4d52-9b8e-ad244be1381b service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Updating instance_info_cache with network_info: [{"id": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "address": "fa:16:3e:7c:c9:53", "network": {"id": "c283b31b-dc07-4174-8354-d08d62d93df9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-305034803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ed90cd886d40f5bf932825592a5be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c01107b-5d", "ovs_interfaceid": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:05 user nova-compute[73627]: WARNING nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received unexpected event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with vm_state active and task_state None.
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Received event network-vif-plugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Acquiring lock "8164bb99-842e-49fc-8f36-093de455c311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Lock "8164bb99-842e-49fc-8f36-093de455c311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Lock "8164bb99-842e-49fc-8f36-093de455c311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] No waiting events found dispatching network-vif-plugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:05 user nova-compute[73627]: WARNING nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Received unexpected event network-vif-plugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 for instance with vm_state active and task_state None.
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Received event network-vif-plugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Acquiring lock "8164bb99-842e-49fc-8f36-093de455c311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Lock "8164bb99-842e-49fc-8f36-093de455c311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Lock "8164bb99-842e-49fc-8f36-093de455c311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] No waiting events found dispatching network-vif-plugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:05 user nova-compute[73627]: WARNING nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Received unexpected event network-vif-plugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 for instance with vm_state active and task_state None.
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] No waiting events found dispatching network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:05 user nova-compute[73627]: WARNING nova.compute.manager [req-197535ff-7154-4655-9b1d-1703a5653ba1 req-da4c838e-e1d7-418f-9332-2a86bfde7c4f service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received unexpected event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d for instance with vm_state active and task_state None.
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-fb114d09-ce97-4112-aee0-c943f3e9c73b req-4deda22e-6204-4f8c-ad2d-c68fb18ea90e service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fb114d09-ce97-4112-aee0-c943f3e9c73b req-4deda22e-6204-4f8c-ad2d-c68fb18ea90e service nova] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fb114d09-ce97-4112-aee0-c943f3e9c73b req-4deda22e-6204-4f8c-ad2d-c68fb18ea90e service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fb114d09-ce97-4112-aee0-c943f3e9c73b req-4deda22e-6204-4f8c-ad2d-c68fb18ea90e service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-fb114d09-ce97-4112-aee0-c943f3e9c73b req-4deda22e-6204-4f8c-ad2d-c68fb18ea90e service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] No waiting events found dispatching network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:05 user nova-compute[73627]: WARNING nova.compute.manager [req-fb114d09-ce97-4112-aee0-c943f3e9c73b req-4deda22e-6204-4f8c-ad2d-c68fb18ea90e service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received unexpected event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d for instance with vm_state active and task_state None.
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1193c38a-176e-4d52-9ec4-bfd64c96a0e0 req-5a4c813f-b6d8-4d52-9b8e-ad244be1381b service nova] Releasing lock "refresh_cache-3b4253a4-1436-4026-8549-f48f1bb8f121" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Acquiring lock "95c10a06-6846-4106-9c43-37054de6bf94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "95c10a06-6846-4106-9c43-37054de6bf94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:24:05 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:24:05 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=7820MB free_disk=25.782928466796875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Instance spawned successfully.
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:24:05 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067045.1387699, 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:24:05 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] VM Started (Lifecycle Event)
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:24:05 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:24:06 user nova-compute[73627]: INFO nova.compute.manager [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Took 10.95 seconds to spawn the instance on the hypervisor.
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:06 user nova-compute[73627]: INFO nova.compute.manager [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Took 12.13 seconds to build instance.
Aug 26 16:24:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-0705a22f-fd22-4eeb-8e3e-71bac7f02489 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.273s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 09d293f0-0c31-4d11-8ba3-b6e2e4881c42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 401459e7-47f6-466a-847f-01c92022bb56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 3b4253a4-1436-4026-8549-f48f1bb8f121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067046.4475214, 3b4253a4-1436-4026-8549-f48f1bb8f121 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:24:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] VM Resumed (Lifecycle Event)
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 95c10a06-6846-4106-9c43-37054de6bf94 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:06 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Instance spawned successfully.
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing inventories for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067046.4477987, 3b4253a4-1436-4026-8549-f48f1bb8f121 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:24:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] VM Started (Lifecycle Event)
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating ProviderTree inventory for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating inventory in ProviderTree for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:24:06 user nova-compute[73627]: INFO nova.compute.manager [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Took 9.82 seconds to spawn the instance on the hypervisor.
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing aggregate associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, aggregates: None {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing trait associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 16:24:06 user nova-compute[73627]: INFO nova.compute.manager [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Took 11.13 seconds to build instance.
Aug 26 16:24:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e223445-07ee-4df1-866d-04f68a2a9b1a tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.316s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:06 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.324s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.508s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:24:07 user nova-compute[73627]: INFO nova.compute.claims [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Claim successful on node user
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:24:07 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.policy [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd968fc519cf14e3489aa16781eaa3915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f21f8623644f4adfc851524cf974b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:24:07 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Creating image(s)
Aug 26 16:24:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Acquiring lock "/opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "/opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "/opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:24:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Skipping network cache update for instance because it is Building. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-09d293f0-0c31-4d11-8ba3-b6e2e4881c42" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-09d293f0-0c31-4d11-8ba3-b6e2e4881c42" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid 09d293f0-0c31-4d11-8ba3-b6e2e4881c42 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.225s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.220s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk 1073741824" returned: 0 in 0.051s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Cannot resize image /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Ensure instance console log exists: /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Successfully created port: 8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Updating instance_info_cache with network_info: [{"id": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "address": "fa:16:3e:14:39:70", "network": {"id": "1a393b72-2045-4ad2-b823-8dd0a0239bf5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2041643108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43cbe040c162469897bb683eeff4d543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4905f341-d7", "ovs_interfaceid": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-09d293f0-0c31-4d11-8ba3-b6e2e4881c42" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:24:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Successfully updated port: 8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Acquiring lock "refresh_cache-95c10a06-6846-4106-9c43-37054de6bf94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Acquired lock "refresh_cache-95c10a06-6846-4106-9c43-37054de6bf94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-a9ce5f64-9447-4cab-86ec-d0c09c8d3d66 req-d7d3312b-0c92-4b3d-83c4-29736bbdbbbb service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Received event network-changed-8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-a9ce5f64-9447-4cab-86ec-d0c09c8d3d66 req-d7d3312b-0c92-4b3d-83c4-29736bbdbbbb service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Refreshing instance network info cache due to event network-changed-8b08cafe-7e41-42b8-8292-62a1396074f3. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a9ce5f64-9447-4cab-86ec-d0c09c8d3d66 req-d7d3312b-0c92-4b3d-83c4-29736bbdbbbb service nova] Acquiring lock "refresh_cache-95c10a06-6846-4106-9c43-37054de6bf94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Updating instance_info_cache with network_info: [{"id": "8b08cafe-7e41-42b8-8292-62a1396074f3", "address": "fa:16:3e:e4:a4:e8", "network": {"id": "a5038e91-bfa4-45bf-8561-a51eea0b0d25", "bridge": "br-int", "label": "tempest-VolumesActionsTest-380490097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "807f21f8623644f4adfc851524cf974b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b08cafe-7e", "ovs_interfaceid": "8b08cafe-7e41-42b8-8292-62a1396074f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Releasing lock "refresh_cache-95c10a06-6846-4106-9c43-37054de6bf94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Instance network_info: |[{"id": "8b08cafe-7e41-42b8-8292-62a1396074f3", "address": "fa:16:3e:e4:a4:e8", "network": {"id": "a5038e91-bfa4-45bf-8561-a51eea0b0d25", "bridge": "br-int", "label": "tempest-VolumesActionsTest-380490097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "807f21f8623644f4adfc851524cf974b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b08cafe-7e", "ovs_interfaceid": "8b08cafe-7e41-42b8-8292-62a1396074f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a9ce5f64-9447-4cab-86ec-d0c09c8d3d66 req-d7d3312b-0c92-4b3d-83c4-29736bbdbbbb service nova] Acquired lock "refresh_cache-95c10a06-6846-4106-9c43-37054de6bf94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.network.neutron [req-a9ce5f64-9447-4cab-86ec-d0c09c8d3d66 req-d7d3312b-0c92-4b3d-83c4-29736bbdbbbb service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Refreshing network info cache for port 8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Start _get_guest_xml network_info=[{"id": "8b08cafe-7e41-42b8-8292-62a1396074f3", "address": "fa:16:3e:e4:a4:e8", "network": {"id": "a5038e91-bfa4-45bf-8561-a51eea0b0d25", "bridge": "br-int", "label": "tempest-VolumesActionsTest-380490097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "807f21f8623644f4adfc851524cf974b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b08cafe-7e", "ovs_interfaceid": "8b08cafe-7e41-42b8-8292-62a1396074f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:24:10 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:24:10 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1277851994',display_name='tempest-VolumesActionsTest-instance-1277851994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1277851994',id=10,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='807f21f8623644f4adfc851524cf974b',ramdisk_id='',reservation_id='r-6wa1815o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1463312229',owner_user_name='tempest-VolumesActionsTest-1463312229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:08Z,user_data=None,user_id='d968fc519cf14e3489aa16781eaa3915',uuid=95c10a06-6846-4106-9c43-37054de6bf94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b08cafe-7e41-42b8-8292-62a1396074f3", "address": "fa:16:3e:e4:a4:e8", "network": {"id": "a5038e91-bfa4-45bf-8561-a51eea0b0d25", "bridge": "br-int", "label": "tempest-VolumesActionsTest-380490097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "807f21f8623644f4adfc851524cf974b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b08cafe-7e", "ovs_interfaceid": "8b08cafe-7e41-42b8-8292-62a1396074f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Converting VIF {"id": "8b08cafe-7e41-42b8-8292-62a1396074f3", "address": "fa:16:3e:e4:a4:e8", "network": {"id": "a5038e91-bfa4-45bf-8561-a51eea0b0d25", "bridge": "br-int", "label": "tempest-VolumesActionsTest-380490097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "807f21f8623644f4adfc851524cf974b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b08cafe-7e", "ovs_interfaceid": "8b08cafe-7e41-42b8-8292-62a1396074f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a4:e8,bridge_name='br-int',has_traffic_filtering=True,id=8b08cafe-7e41-42b8-8292-62a1396074f3,network=Network(a5038e91-bfa4-45bf-8561-a51eea0b0d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b08cafe-7e') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lazy-loading 'pci_devices' on Instance uuid 95c10a06-6846-4106-9c43-37054de6bf94 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:24:10 user nova-compute[73627]:   <uuid>95c10a06-6846-4106-9c43-37054de6bf94</uuid>
Aug 26 16:24:10 user nova-compute[73627]:   <name>instance-0000000a</name>
Aug 26 16:24:10 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:24:10 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:24:10 user nova-compute[73627]:   <metadata>
Aug 26 16:24:10 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:24:10 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:24:10 user nova-compute[73627]:       <nova:name>tempest-VolumesActionsTest-instance-1277851994</nova:name>
Aug 26 16:24:10 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:24:10</nova:creationTime>
Aug 26 16:24:10 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:24:10 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:24:10 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:24:10 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:24:10 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:24:10 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:24:10 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:24:10 user nova-compute[73627]:       <nova:owner>
Aug 26 16:24:10 user nova-compute[73627]:         <nova:user uuid="d968fc519cf14e3489aa16781eaa3915">tempest-VolumesActionsTest-1463312229-project-member</nova:user>
Aug 26 16:24:10 user nova-compute[73627]:         <nova:project uuid="807f21f8623644f4adfc851524cf974b">tempest-VolumesActionsTest-1463312229</nova:project>
Aug 26 16:24:10 user nova-compute[73627]:       </nova:owner>
Aug 26 16:24:10 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:24:10 user nova-compute[73627]:       <nova:ports>
Aug 26 16:24:10 user nova-compute[73627]:         <nova:port uuid="8b08cafe-7e41-42b8-8292-62a1396074f3">
Aug 26 16:24:10 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 16:24:10 user nova-compute[73627]:         </nova:port>
Aug 26 16:24:10 user nova-compute[73627]:       </nova:ports>
Aug 26 16:24:10 user nova-compute[73627]:     </nova:instance>
Aug 26 16:24:10 user nova-compute[73627]:   </metadata>
Aug 26 16:24:10 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:24:10 user nova-compute[73627]:     <system>
Aug 26 16:24:10 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:24:10 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:24:10 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:24:10 user nova-compute[73627]:       <entry name="serial">95c10a06-6846-4106-9c43-37054de6bf94</entry>
Aug 26 16:24:10 user nova-compute[73627]:       <entry name="uuid">95c10a06-6846-4106-9c43-37054de6bf94</entry>
Aug 26 16:24:10 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:24:10 user nova-compute[73627]:     </system>
Aug 26 16:24:10 user nova-compute[73627]:   </sysinfo>
Aug 26 16:24:10 user nova-compute[73627]:   <os>
Aug 26 16:24:10 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:24:10 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:24:10 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:24:10 user nova-compute[73627]:   </os>
Aug 26 16:24:10 user nova-compute[73627]:   <features>
Aug 26 16:24:10 user nova-compute[73627]:     <acpi/>
Aug 26 16:24:10 user nova-compute[73627]:     <apic/>
Aug 26 16:24:10 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:24:10 user nova-compute[73627]:   </features>
Aug 26 16:24:10 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:24:10 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:24:10 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:24:10 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:24:10 user nova-compute[73627]:   </clock>
Aug 26 16:24:10 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:24:10 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:24:10 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:24:10 user nova-compute[73627]:   </cpu>
Aug 26 16:24:10 user nova-compute[73627]:   <devices>
Aug 26 16:24:10 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:24:10 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:24:10 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk"/>
Aug 26 16:24:10 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:24:10 user nova-compute[73627]:     </disk>
Aug 26 16:24:10 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:24:10 user nova-compute[73627]:       <mac address="fa:16:3e:e4:a4:e8"/>
Aug 26 16:24:10 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:24:10 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:24:10 user nova-compute[73627]:       <target dev="tap8b08cafe-7e"/>
Aug 26 16:24:10 user nova-compute[73627]:     </interface>
Aug 26 16:24:10 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:24:10 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/console.log" append="off"/>
Aug 26 16:24:10 user nova-compute[73627]:     </serial>
Aug 26 16:24:10 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:24:10 user nova-compute[73627]:     <video>
Aug 26 16:24:10 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:24:10 user nova-compute[73627]:     </video>
Aug 26 16:24:10 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:24:10 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:24:10 user nova-compute[73627]:     </rng>
Aug 26 16:24:10 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:24:10 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:24:10 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:24:10 user nova-compute[73627]:     </memballoon>
Aug 26 16:24:10 user nova-compute[73627]:   </devices>
Aug 26 16:24:10 user nova-compute[73627]: </domain>
Aug 26 16:24:10 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1277851994',display_name='tempest-VolumesActionsTest-instance-1277851994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1277851994',id=10,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='807f21f8623644f4adfc851524cf974b',ramdisk_id='',reservation_id='r-6wa1815o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1463312229',owner_user_name='tempest-VolumesActionsTest-1463312229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:08Z,user_data=None,user_id='d968fc519cf14e3489aa16781eaa3915',uuid=95c10a06-6846-4106-9c43-37054de6bf94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b08cafe-7e41-42b8-8292-62a1396074f3", "address": "fa:16:3e:e4:a4:e8", "network": {"id": "a5038e91-bfa4-45bf-8561-a51eea0b0d25", "bridge": "br-int", "label": "tempest-VolumesActionsTest-380490097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "807f21f8623644f4adfc851524cf974b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b08cafe-7e", "ovs_interfaceid": "8b08cafe-7e41-42b8-8292-62a1396074f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Converting VIF {"id": "8b08cafe-7e41-42b8-8292-62a1396074f3", "address": "fa:16:3e:e4:a4:e8", "network": {"id": "a5038e91-bfa4-45bf-8561-a51eea0b0d25", "bridge": "br-int", "label": "tempest-VolumesActionsTest-380490097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "807f21f8623644f4adfc851524cf974b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b08cafe-7e", "ovs_interfaceid": "8b08cafe-7e41-42b8-8292-62a1396074f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a4:e8,bridge_name='br-int',has_traffic_filtering=True,id=8b08cafe-7e41-42b8-8292-62a1396074f3,network=Network(a5038e91-bfa4-45bf-8561-a51eea0b0d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b08cafe-7e') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG os_vif [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a4:e8,bridge_name='br-int',has_traffic_filtering=True,id=8b08cafe-7e41-42b8-8292-62a1396074f3,network=Network(a5038e91-bfa4-45bf-8561-a51eea0b0d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b08cafe-7e') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b08cafe-7e, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b08cafe-7e, col_values=(('external_ids', {'iface-id': '8b08cafe-7e41-42b8-8292-62a1396074f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:a4:e8', 'vm-uuid': '95c10a06-6846-4106-9c43-37054de6bf94'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:10 user nova-compute[73627]: INFO os_vif [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a4:e8,bridge_name='br-int',has_traffic_filtering=True,id=8b08cafe-7e41-42b8-8292-62a1396074f3,network=Network(a5038e91-bfa4-45bf-8561-a51eea0b0d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b08cafe-7e')
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:24:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] No VIF found with MAC fa:16:3e:e4:a4:e8, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:24:11 user nova-compute[73627]: DEBUG nova.network.neutron [req-a9ce5f64-9447-4cab-86ec-d0c09c8d3d66 req-d7d3312b-0c92-4b3d-83c4-29736bbdbbbb service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Updated VIF entry in instance network info cache for port 8b08cafe-7e41-42b8-8292-62a1396074f3. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:24:11 user nova-compute[73627]: DEBUG nova.network.neutron [req-a9ce5f64-9447-4cab-86ec-d0c09c8d3d66 req-d7d3312b-0c92-4b3d-83c4-29736bbdbbbb service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Updating instance_info_cache with network_info: [{"id": "8b08cafe-7e41-42b8-8292-62a1396074f3", "address": "fa:16:3e:e4:a4:e8", "network": {"id": "a5038e91-bfa4-45bf-8561-a51eea0b0d25", "bridge": "br-int", "label": "tempest-VolumesActionsTest-380490097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "807f21f8623644f4adfc851524cf974b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b08cafe-7e", "ovs_interfaceid": "8b08cafe-7e41-42b8-8292-62a1396074f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a9ce5f64-9447-4cab-86ec-d0c09c8d3d66 req-d7d3312b-0c92-4b3d-83c4-29736bbdbbbb service nova] Releasing lock "refresh_cache-95c10a06-6846-4106-9c43-37054de6bf94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-915c897e-6a72-490e-b57e-fde2211a0cc4 req-9a0d314d-81bc-4552-a69e-8d18a995facf service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Received event network-vif-plugged-8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-915c897e-6a72-490e-b57e-fde2211a0cc4 req-9a0d314d-81bc-4552-a69e-8d18a995facf service nova] Acquiring lock "95c10a06-6846-4106-9c43-37054de6bf94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-915c897e-6a72-490e-b57e-fde2211a0cc4 req-9a0d314d-81bc-4552-a69e-8d18a995facf service nova] Lock "95c10a06-6846-4106-9c43-37054de6bf94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-915c897e-6a72-490e-b57e-fde2211a0cc4 req-9a0d314d-81bc-4552-a69e-8d18a995facf service nova] Lock "95c10a06-6846-4106-9c43-37054de6bf94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-915c897e-6a72-490e-b57e-fde2211a0cc4 req-9a0d314d-81bc-4552-a69e-8d18a995facf service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] No waiting events found dispatching network-vif-plugged-8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:12 user nova-compute[73627]: WARNING nova.compute.manager [req-915c897e-6a72-490e-b57e-fde2211a0cc4 req-9a0d314d-81bc-4552-a69e-8d18a995facf service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Received unexpected event network-vif-plugged-8b08cafe-7e41-42b8-8292-62a1396074f3 for instance with vm_state building and task_state spawning.
Aug 26 16:24:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:24:12 user nova-compute[73627]: INFO nova.compute.claims [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Claim successful on node user
Aug 26 16:24:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:13 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:24:13 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:24:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:24:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:24:13 user nova-compute[73627]: DEBUG nova.network.neutron [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:24:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:24:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:24:13 user nova-compute[73627]: INFO nova.virt.block_device [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Booting with volume d582e6d4-e3f2-4216-8fa6-26ccfbc29578 at /dev/vda
Aug 26 16:24:13 user nova-compute[73627]: DEBUG nova.policy [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '063c3d4f532c4a3da674054d3dfeb5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0c3d55d3c488a978986d609f8bdb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:24:13 user nova-compute[73627]: DEBUG os_brick.utils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:24:13 user nova-compute[73627]: INFO oslo.privsep.daemon [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp5v4le2hq/privsep.sock']
Aug 26 16:24:13 user sudo[84796]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp5v4le2hq/privsep.sock
Aug 26 16:24:13 user sudo[84796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.network.neutron [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Successfully created port: 8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-599f0fad-b79e-46c5-8cd6-5fec3a23f4dc req-c9badd20-3111-4a16-abd8-d129e2df60d4 service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Received event network-vif-plugged-8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-599f0fad-b79e-46c5-8cd6-5fec3a23f4dc req-c9badd20-3111-4a16-abd8-d129e2df60d4 service nova] Acquiring lock "95c10a06-6846-4106-9c43-37054de6bf94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-599f0fad-b79e-46c5-8cd6-5fec3a23f4dc req-c9badd20-3111-4a16-abd8-d129e2df60d4 service nova] Lock "95c10a06-6846-4106-9c43-37054de6bf94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-599f0fad-b79e-46c5-8cd6-5fec3a23f4dc req-c9badd20-3111-4a16-abd8-d129e2df60d4 service nova] Lock "95c10a06-6846-4106-9c43-37054de6bf94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-599f0fad-b79e-46c5-8cd6-5fec3a23f4dc req-c9badd20-3111-4a16-abd8-d129e2df60d4 service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] No waiting events found dispatching network-vif-plugged-8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:14 user nova-compute[73627]: WARNING nova.compute.manager [req-599f0fad-b79e-46c5-8cd6-5fec3a23f4dc req-c9badd20-3111-4a16-abd8-d129e2df60d4 service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Received unexpected event network-vif-plugged-8b08cafe-7e41-42b8-8292-62a1396074f3 for instance with vm_state building and task_state spawning.
Aug 26 16:24:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067054.5953395, 95c10a06-6846-4106-9c43-37054de6bf94 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:24:14 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] VM Resumed (Lifecycle Event)
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:24:14 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Instance spawned successfully.
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:24:14 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067054.5994642, 95c10a06-6846-4106-9c43-37054de6bf94 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:24:14 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] VM Started (Lifecycle Event)
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:24:14 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:24:14 user nova-compute[73627]: INFO nova.compute.manager [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Took 6.97 seconds to spawn the instance on the hypervisor.
Aug 26 16:24:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:14 user nova-compute[73627]: INFO nova.compute.manager [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Took 8.91 seconds to build instance.
Aug 26 16:24:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4186a51d-f014-47fb-b416-7337978d66f5 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "95c10a06-6846-4106-9c43-37054de6bf94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.238s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Successfully updated port: 8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "refresh_cache-f34a8233-5a54-4a28-b57f-096e8526e80e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquired lock "refresh_cache-f34a8233-5a54-4a28-b57f-096e8526e80e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG nova.compute.manager [req-20a4ddf3-3b38-49c5-9fa8-44a29380813a req-87d4c3cf-79aa-4264-9205-46c8e4b12d3d service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-changed-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG nova.compute.manager [req-20a4ddf3-3b38-49c5-9fa8-44a29380813a req-87d4c3cf-79aa-4264-9205-46c8e4b12d3d service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Refreshing instance network info cache due to event network-changed-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-20a4ddf3-3b38-49c5-9fa8-44a29380813a req-87d4c3cf-79aa-4264-9205-46c8e4b12d3d service nova] Acquiring lock "refresh_cache-f34a8233-5a54-4a28-b57f-096e8526e80e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:24:15 user sudo[84796]: pam_unix(sudo:session): session closed for user root
Aug 26 16:24:15 user nova-compute[73627]: INFO oslo.privsep.daemon [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Spawned new privsep daemon via rootwrap
Aug 26 16:24:15 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 16:24:15 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 16:24:15 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 26 16:24:15 user nova-compute[73627]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84800
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbadc5a-cc56-45cc-99b5-83bc51395d8a]: (2,) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Updating instance_info_cache with network_info: [{"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Releasing lock "refresh_cache-f34a8233-5a54-4a28-b57f-096e8526e80e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Instance network_info: |[{"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-20a4ddf3-3b38-49c5-9fa8-44a29380813a req-87d4c3cf-79aa-4264-9205-46c8e4b12d3d service nova] Acquired lock "refresh_cache-f34a8233-5a54-4a28-b57f-096e8526e80e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG nova.network.neutron [req-20a4ddf3-3b38-49c5-9fa8-44a29380813a req-87d4c3cf-79aa-4264-9205-46c8e4b12d3d service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Refreshing network info cache for port 8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[514dfdff-0960-4e02-8a06-0eaf3e58f466]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:15 user nova-compute[73627]: WARNING os_brick.initiator.connectors.nvmeof [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.034s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6721fa-d80c-456d-9383-ea1fc50e54eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6988899-3f53-4cf6-a5d6-e6774b10388b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a8b71d-f09e-476c-9ee6-9f5da55cc4c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:24:15 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:24:15 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f55c9ba-343f-456a-85a5-c81e1b54f857]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:24:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:24:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:24:16 user nova-compute[73627]: DEBUG os_brick.utils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] <== get_connector_properties: return (2294ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:24:16 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Updating existing volume attachment record: 70310654-39e2-4aa7-aaa7-20dbd19fba80 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:24:16 user nova-compute[73627]: DEBUG nova.network.neutron [req-20a4ddf3-3b38-49c5-9fa8-44a29380813a req-87d4c3cf-79aa-4264-9205-46c8e4b12d3d service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Updated VIF entry in instance network info cache for port 8408461f-84dc-4d3c-afa8-c6b8a2b8ab97. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:24:16 user nova-compute[73627]: DEBUG nova.network.neutron [req-20a4ddf3-3b38-49c5-9fa8-44a29380813a req-87d4c3cf-79aa-4264-9205-46c8e4b12d3d service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Updating instance_info_cache with network_info: [{"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-20a4ddf3-3b38-49c5-9fa8-44a29380813a req-87d4c3cf-79aa-4264-9205-46c8e4b12d3d service nova] Releasing lock "refresh_cache-f34a8233-5a54-4a28-b57f-096e8526e80e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-7a2ee49a-895c-4c67-9e44-b1044ae77f13 req-5788b1ea-5d62-40e9-b9a8-7e16235fb3d6 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-vif-plugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7a2ee49a-895c-4c67-9e44-b1044ae77f13 req-5788b1ea-5d62-40e9-b9a8-7e16235fb3d6 service nova] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7a2ee49a-895c-4c67-9e44-b1044ae77f13 req-5788b1ea-5d62-40e9-b9a8-7e16235fb3d6 service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7a2ee49a-895c-4c67-9e44-b1044ae77f13 req-5788b1ea-5d62-40e9-b9a8-7e16235fb3d6 service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-7a2ee49a-895c-4c67-9e44-b1044ae77f13 req-5788b1ea-5d62-40e9-b9a8-7e16235fb3d6 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] No waiting events found dispatching network-vif-plugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:21 user nova-compute[73627]: WARNING nova.compute.manager [req-7a2ee49a-895c-4c67-9e44-b1044ae77f13 req-5788b1ea-5d62-40e9-b9a8-7e16235fb3d6 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received unexpected event network-vif-plugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 for instance with vm_state active and task_state None.
Aug 26 16:24:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-15b2e027-5c45-4e2c-85fb-865a28598cae req-60d525a0-6655-4e8b-af16-224653b22c88 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-vif-plugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-15b2e027-5c45-4e2c-85fb-865a28598cae req-60d525a0-6655-4e8b-af16-224653b22c88 service nova] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-15b2e027-5c45-4e2c-85fb-865a28598cae req-60d525a0-6655-4e8b-af16-224653b22c88 service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-15b2e027-5c45-4e2c-85fb-865a28598cae req-60d525a0-6655-4e8b-af16-224653b22c88 service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-15b2e027-5c45-4e2c-85fb-865a28598cae req-60d525a0-6655-4e8b-af16-224653b22c88 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] No waiting events found dispatching network-vif-plugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:23 user nova-compute[73627]: WARNING nova.compute.manager [req-15b2e027-5c45-4e2c-85fb-865a28598cae req-60d525a0-6655-4e8b-af16-224653b22c88 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received unexpected event network-vif-plugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 for instance with vm_state active and task_state None.
Aug 26 16:24:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-b6e9cc7d-bb7d-4599-b1c9-1614d4d30daa req-9f173a37-a569-4233-b00f-65becc0939e3 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Received event network-vif-plugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6e9cc7d-bb7d-4599-b1c9-1614d4d30daa req-9f173a37-a569-4233-b00f-65becc0939e3 service nova] Acquiring lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6e9cc7d-bb7d-4599-b1c9-1614d4d30daa req-9f173a37-a569-4233-b00f-65becc0939e3 service nova] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6e9cc7d-bb7d-4599-b1c9-1614d4d30daa req-9f173a37-a569-4233-b00f-65becc0939e3 service nova] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-b6e9cc7d-bb7d-4599-b1c9-1614d4d30daa req-9f173a37-a569-4233-b00f-65becc0939e3 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] No waiting events found dispatching network-vif-plugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:27 user nova-compute[73627]: WARNING nova.compute.manager [req-b6e9cc7d-bb7d-4599-b1c9-1614d4d30daa req-9f173a37-a569-4233-b00f-65becc0939e3 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Received unexpected event network-vif-plugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 for instance with vm_state active and task_state None.
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:24:27 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Creating image(s)
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Ensure instance console log exists: /opt/stack/data/nova/instances/f34a8233-5a54-4a28-b57f-096e8526e80e/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Start _get_guest_xml network_info=[{"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEWqVeDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f34a8233-5a54-4a28-b57f-096e8526e80e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd582e6d4-e3f2-4216-8fa6-26ccfbc29578', 'serial': 'd582e6d4-e3f2-4216-8fa6-26ccfbc29578'}, 'guest_format': None, 'attachment_id': '70310654-39e2-4aa7-aaa7-20dbd19fba80', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:24:27 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:24:27 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG os_brick.initiator.connector [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Factory for ISCSI on None {{(pid=73627) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEWqVeDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:24:27 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:24:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:24:27 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:24:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:24:27 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0823ae-6819-4e22-ad1e-5d28aec5159a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:24:27 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfc2a0b-62b4-49b1-b26d-7381d5ec5087]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578] added
Aug 26 16:24:27 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fe9922-01bb-45c5-ba18-8eeaf84c53f2]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb4683f-7a3d-44e7-b1d3-17b7e50184ce]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEWqVeDd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEWqVeDd" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[59247630-3f44-4401-a635-58c1198ae8ff]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MEWqVeDd'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:24:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c3da73-f3f5-4ea6-bf92-6088dfd11ad8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[738d775d-5fb3-43f3-90d1-81d637e431ec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:24:28 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:24:28 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:24:28 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 16:24:28 user nova-compute[73627]: 
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2450dea5-46a0-467f-92c3-a5464a8a380e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260]
Aug 26 16:24:28 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260] successful.
Aug 26 16:24:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c459076f-23cf-4bf2-a2be-6f5caec57e9f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f15ed-c77c-4c51-b076-3846cbf1acf2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:24:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:24:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aa2c17-c3e2-416b-8ece-9ef1dea3019c]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:24:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEWqVeDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26662663965393938', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662663965393938', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-221217757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-221217757',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZg30xf6ADFM2OrxzbSgKjl2I1mfRaXR7ksJbPemPRCTfCXrd27g1yT4kPNFBVdl+SB80btIVwzCgShhqlwfrFbHefKSSkDAwBQ1ev0GfUUbSpBCNWTJ8+qVVI2IoozJQ==',key_name='tempest-keypair-661931287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1c0c3d55d3c488a978986d609f8bdb9',ramdisk_id='',reservation_id='r-lj2vpcg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-332170589',owner_user_name='tempest-ServerActionsV293TestJSON-332170589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063c3d4f532c4a3da674054d3dfeb5de',uuid=f34a8233-5a54-4a28-b57f-096e8526e80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converting VIF {"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.objects.instance [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lazy-loading 'pci_devices' on Instance uuid f34a8233-5a54-4a28-b57f-096e8526e80e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:24:29 user nova-compute[73627]:   <uuid>f34a8233-5a54-4a28-b57f-096e8526e80e</uuid>
Aug 26 16:24:29 user nova-compute[73627]:   <name>instance-0000000b</name>
Aug 26 16:24:29 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:24:29 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:24:29 user nova-compute[73627]:   <metadata>
Aug 26 16:24:29 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:24:29 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:24:29 user nova-compute[73627]:       <nova:name>tempest-ServerActionsV293TestJSON-server-221217757</nova:name>
Aug 26 16:24:29 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:24:27</nova:creationTime>
Aug 26 16:24:29 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:24:29 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:24:29 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:24:29 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:24:29 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:24:29 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:24:29 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:24:29 user nova-compute[73627]:       <nova:owner>
Aug 26 16:24:29 user nova-compute[73627]:         <nova:user uuid="063c3d4f532c4a3da674054d3dfeb5de">tempest-ServerActionsV293TestJSON-332170589-project-member</nova:user>
Aug 26 16:24:29 user nova-compute[73627]:         <nova:project uuid="a1c0c3d55d3c488a978986d609f8bdb9">tempest-ServerActionsV293TestJSON-332170589</nova:project>
Aug 26 16:24:29 user nova-compute[73627]:       </nova:owner>
Aug 26 16:24:29 user nova-compute[73627]:       <nova:ports>
Aug 26 16:24:29 user nova-compute[73627]:         <nova:port uuid="8408461f-84dc-4d3c-afa8-c6b8a2b8ab97">
Aug 26 16:24:29 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 16:24:29 user nova-compute[73627]:         </nova:port>
Aug 26 16:24:29 user nova-compute[73627]:       </nova:ports>
Aug 26 16:24:29 user nova-compute[73627]:     </nova:instance>
Aug 26 16:24:29 user nova-compute[73627]:   </metadata>
Aug 26 16:24:29 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:24:29 user nova-compute[73627]:     <system>
Aug 26 16:24:29 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:24:29 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:24:29 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:24:29 user nova-compute[73627]:       <entry name="serial">f34a8233-5a54-4a28-b57f-096e8526e80e</entry>
Aug 26 16:24:29 user nova-compute[73627]:       <entry name="uuid">f34a8233-5a54-4a28-b57f-096e8526e80e</entry>
Aug 26 16:24:29 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:24:29 user nova-compute[73627]:     </system>
Aug 26 16:24:29 user nova-compute[73627]:   </sysinfo>
Aug 26 16:24:29 user nova-compute[73627]:   <os>
Aug 26 16:24:29 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:24:29 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:24:29 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:24:29 user nova-compute[73627]:   </os>
Aug 26 16:24:29 user nova-compute[73627]:   <features>
Aug 26 16:24:29 user nova-compute[73627]:     <acpi/>
Aug 26 16:24:29 user nova-compute[73627]:     <apic/>
Aug 26 16:24:29 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:24:29 user nova-compute[73627]:   </features>
Aug 26 16:24:29 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:24:29 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:24:29 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:24:29 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:24:29 user nova-compute[73627]:   </clock>
Aug 26 16:24:29 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:24:29 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:24:29 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:24:29 user nova-compute[73627]:   </cpu>
Aug 26 16:24:29 user nova-compute[73627]:   <devices>
Aug 26 16:24:29 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:24:29 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:24:29 user nova-compute[73627]:       <source dev="/dev/sdb"/>
Aug 26 16:24:29 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:24:29 user nova-compute[73627]:       <serial>d582e6d4-e3f2-4216-8fa6-26ccfbc29578</serial>
Aug 26 16:24:29 user nova-compute[73627]:     </disk>
Aug 26 16:24:29 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:24:29 user nova-compute[73627]:       <mac address="fa:16:3e:7b:15:82"/>
Aug 26 16:24:29 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:24:29 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:24:29 user nova-compute[73627]:       <target dev="tap8408461f-84"/>
Aug 26 16:24:29 user nova-compute[73627]:     </interface>
Aug 26 16:24:29 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:24:29 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/f34a8233-5a54-4a28-b57f-096e8526e80e/console.log" append="off"/>
Aug 26 16:24:29 user nova-compute[73627]:     </serial>
Aug 26 16:24:29 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:24:29 user nova-compute[73627]:     <video>
Aug 26 16:24:29 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:24:29 user nova-compute[73627]:     </video>
Aug 26 16:24:29 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:24:29 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:24:29 user nova-compute[73627]:     </rng>
Aug 26 16:24:29 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:24:29 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:24:29 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:24:29 user nova-compute[73627]:     </memballoon>
Aug 26 16:24:29 user nova-compute[73627]:   </devices>
Aug 26 16:24:29 user nova-compute[73627]: </domain>
Aug 26 16:24:29 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-221217757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-221217757',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZg30xf6ADFM2OrxzbSgKjl2I1mfRaXR7ksJbPemPRCTfCXrd27g1yT4kPNFBVdl+SB80btIVwzCgShhqlwfrFbHefKSSkDAwBQ1ev0GfUUbSpBCNWTJ8+qVVI2IoozJQ==',key_name='tempest-keypair-661931287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1c0c3d55d3c488a978986d609f8bdb9',ramdisk_id='',reservation_id='r-lj2vpcg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-332170589',owner_user_name='tempest-ServerActionsV293TestJSON-332170589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063c3d4f532c4a3da674054d3dfeb5de',uuid=f34a8233-5a54-4a28-b57f-096e8526e80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converting VIF {"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG os_vif [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8408461f-84, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8408461f-84, col_values=(('external_ids', {'iface-id': '8408461f-84dc-4d3c-afa8-c6b8a2b8ab97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:15:82', 'vm-uuid': 'f34a8233-5a54-4a28-b57f-096e8526e80e'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:29 user nova-compute[73627]: INFO os_vif [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84')
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] No VIF found with MAC fa:16:3e:7b:15:82, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-f55d3c4f-1ae9-41f1-ba7b-d6c8ff99d2c2 req-d86e0c49-43a0-48ca-9d53-a4dbbf64d6f4 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Received event network-vif-plugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f55d3c4f-1ae9-41f1-ba7b-d6c8ff99d2c2 req-d86e0c49-43a0-48ca-9d53-a4dbbf64d6f4 service nova] Acquiring lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f55d3c4f-1ae9-41f1-ba7b-d6c8ff99d2c2 req-d86e0c49-43a0-48ca-9d53-a4dbbf64d6f4 service nova] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f55d3c4f-1ae9-41f1-ba7b-d6c8ff99d2c2 req-d86e0c49-43a0-48ca-9d53-a4dbbf64d6f4 service nova] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-f55d3c4f-1ae9-41f1-ba7b-d6c8ff99d2c2 req-d86e0c49-43a0-48ca-9d53-a4dbbf64d6f4 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] No waiting events found dispatching network-vif-plugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:29 user nova-compute[73627]: WARNING nova.compute.manager [req-f55d3c4f-1ae9-41f1-ba7b-d6c8ff99d2c2 req-d86e0c49-43a0-48ca-9d53-a4dbbf64d6f4 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Received unexpected event network-vif-plugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 for instance with vm_state active and task_state None.
Aug 26 16:24:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] No waiting events found dispatching network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:31 user nova-compute[73627]: WARNING nova.compute.manager [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received unexpected event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 for instance with vm_state building and task_state spawning.
Aug 26 16:24:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] No waiting events found dispatching network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:24:31 user nova-compute[73627]: WARNING nova.compute.manager [req-52c18368-bd24-437d-9381-2b162bc8b7ec req-baa7aabc-af62-4eeb-9246-fb3c0ff5c5bd service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received unexpected event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 for instance with vm_state building and task_state spawning.
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067072.8027718, f34a8233-5a54-4a28-b57f-096e8526e80e => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:24:32 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] VM Resumed (Lifecycle Event)
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:24:32 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Instance spawned successfully.
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:24:32 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067072.8042126, f34a8233-5a54-4a28-b57f-096e8526e80e => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:24:32 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] VM Started (Lifecycle Event)
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:24:32 user nova-compute[73627]: INFO nova.compute.manager [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Took 5.12 seconds to spawn the instance on the hypervisor.
Aug 26 16:24:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:32 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:24:33 user nova-compute[73627]: INFO nova.compute.manager [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Took 20.27 seconds to build instance.
Aug 26 16:24:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-89000f6f-0a1c-4f43-8c4d-66507e612932 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.382s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:49 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:24:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:24:49 user nova-compute[73627]: INFO nova.compute.claims [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Claim successful on node user
Aug 26 16:24:50 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:24:50 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:24:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:24:50 user nova-compute[73627]: INFO nova.virt.block_device [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Booting with volume 2046ca53-76ca-4a65-a4af-48a244aec175 at /dev/vda
Aug 26 16:24:50 user nova-compute[73627]: DEBUG nova.policy [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de7ed97bdd2c487798ba4608ba5a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66759aba5e2e4d859ccff1255e821a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG os_brick.utils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9b3334-6899-41be-9674-1f18d97b830e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96d642b-8dd5-477e-ab81-c58b4ccafada]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9872c9d-4a77-4685-a4a6-08404d3f1718]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[712a1960-f56e-4448-a449-bda5666080d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:24:50 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:24:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7653d9-faf4-43aa-ba73-e7410edf69f3]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG os_brick.utils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:24:50 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating existing volume attachment record: c7f77cea-cd04-4714-b3f6-ba1e7ac70ebb {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:24:51 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully created port: 9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:51 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully created port: a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:52 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully created port: c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:52 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully created port: ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:53 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully created port: c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "f961b797-16bd-43bd-8735-93578f1084cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:24:54 user nova-compute[73627]: INFO nova.compute.claims [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Claim successful on node user
Aug 26 16:24:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully updated port: 9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-42b24cdb-c1f6-4a77-bb42-85776a68453a req-f2e48de2-71d6-4ddc-a6cd-8af2763372c5 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-changed-9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-42b24cdb-c1f6-4a77-bb42-85776a68453a req-f2e48de2-71d6-4ddc-a6cd-8af2763372c5 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing instance network info cache due to event network-changed-9adc995e-548e-4c77-9ce2-42abba1ddc8a. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42b24cdb-c1f6-4a77-bb42-85776a68453a req-f2e48de2-71d6-4ddc-a6cd-8af2763372c5 service nova] Acquiring lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42b24cdb-c1f6-4a77-bb42-85776a68453a req-f2e48de2-71d6-4ddc-a6cd-8af2763372c5 service nova] Acquired lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.network.neutron [req-42b24cdb-c1f6-4a77-bb42-85776a68453a req-f2e48de2-71d6-4ddc-a6cd-8af2763372c5 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing network info cache for port 9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.network.neutron [req-42b24cdb-c1f6-4a77-bb42-85776a68453a req-f2e48de2-71d6-4ddc-a6cd-8af2763372c5 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:24:54 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:24:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:24:54 user nova-compute[73627]: INFO nova.virt.block_device [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Booting with volume e9b2c748-f107-4a1d-87a3-dbbe8f232242 at /dev/vda
Aug 26 16:24:54 user nova-compute[73627]: DEBUG os_brick.utils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9dc552-3091-4641-9ac6-6e1aeb202eb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb06238-d144-4190-b4d0-97519a40902e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41a7a9e-8ff3-4f2b-b25b-3d4be7d6862e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b2ac01-3383-4a71-a42c-af8fa52870e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.network.neutron [req-42b24cdb-c1f6-4a77-bb42-85776a68453a req-f2e48de2-71d6-4ddc-a6cd-8af2763372c5 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.policy [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53847c7a2cea42f8ae4aeecea2053ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2462ff948ebb487d92ac3a3e2b281102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42b24cdb-c1f6-4a77-bb42-85776a68453a req-f2e48de2-71d6-4ddc-a6cd-8af2763372c5 service nova] Releasing lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:24:54 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:24:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39b9bef-9f79-49a5-b402-9ad50464f463]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG os_brick.utils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:24:54 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating existing volume attachment record: 454a3362-cb61-41c1-a21a-833e037212d7 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:24:55 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully updated port: 8d5d4266-25e9-425f-ac4f-80fd24af6c31 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:24:55 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully created port: d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully updated port: 1c1a1228-7701-4e82-872b-23fbde018c1d {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully created port: fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-changed-8d5d4266-25e9-425f-ac4f-80fd24af6c31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing instance network info cache due to event network-changed-8d5d4266-25e9-425f-ac4f-80fd24af6c31. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] Acquiring lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] Acquired lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG nova.network.neutron [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing network info cache for port 8d5d4266-25e9-425f-ac4f-80fd24af6c31 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG nova.network.neutron [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully created port: 89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG nova.network.neutron [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] Releasing lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-changed-1c1a1228-7701-4e82-872b-23fbde018c1d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing instance network info cache due to event network-changed-1c1a1228-7701-4e82-872b-23fbde018c1d. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] Acquiring lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] Acquired lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:56 user nova-compute[73627]: DEBUG nova.network.neutron [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing network info cache for port 1c1a1228-7701-4e82-872b-23fbde018c1d {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:24:57 user nova-compute[73627]: DEBUG nova.network.neutron [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:24:57 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully updated port: a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:24:57 user nova-compute[73627]: DEBUG nova.network.neutron [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-34f41f55-3027-45ec-a050-0fc21e097a6d req-12035edd-6f07-4b5f-bc91-256bb606773f service nova] Releasing lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:57 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully created port: 0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully updated port: c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully created port: 60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-changed-a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing instance network info cache due to event network-changed-a6b1395b-20a9-448b-97be-e353b593be0e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] Acquiring lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] Acquired lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG nova.network.neutron [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing network info cache for port a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG nova.network.neutron [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:58 user nova-compute[73627]: DEBUG nova.network.neutron [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] Releasing lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-changed-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing instance network info cache due to event network-changed-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] Acquiring lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] Acquired lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.network.neutron [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing network info cache for port c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully updated port: d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-a8db94a4-ca5e-4b3a-9670-fa6d6475f5c2 req-44e220f6-7cbf-4794-94a8-28d22dadb580 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-changed-d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-a8db94a4-ca5e-4b3a-9670-fa6d6475f5c2 req-44e220f6-7cbf-4794-94a8-28d22dadb580 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing instance network info cache due to event network-changed-d01767e2-a65b-4bbd-ae31-97eccf191447. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a8db94a4-ca5e-4b3a-9670-fa6d6475f5c2 req-44e220f6-7cbf-4794-94a8-28d22dadb580 service nova] Acquiring lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a8db94a4-ca5e-4b3a-9670-fa6d6475f5c2 req-44e220f6-7cbf-4794-94a8-28d22dadb580 service nova] Acquired lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.network.neutron [req-a8db94a4-ca5e-4b3a-9670-fa6d6475f5c2 req-44e220f6-7cbf-4794-94a8-28d22dadb580 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing network info cache for port d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.network.neutron [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.network.neutron [req-a8db94a4-ca5e-4b3a-9670-fa6d6475f5c2 req-44e220f6-7cbf-4794-94a8-28d22dadb580 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:24:59 user nova-compute[73627]: INFO nova.compute.manager [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] instance snapshotting
Aug 26 16:24:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Beginning live snapshot process
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.network.neutron [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.network.neutron [req-a8db94a4-ca5e-4b3a-9670-fa6d6475f5c2 req-44e220f6-7cbf-4794-94a8-28d22dadb580 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully updated port: ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a8db94a4-ca5e-4b3a-9670-fa6d6475f5c2 req-44e220f6-7cbf-4794-94a8-28d22dadb580 service nova] Releasing lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7bfb3152-7207-4493-b7a4-e5d4b7bf279e req-4b1723e4-f303-4182-a0ba-a995e4badf01 service nova] Releasing lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json -f qcow2 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:24:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json -f qcow2 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully updated port: e0e633e2-4663-405f-a0f4-b9dc5b3712a9 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.205s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpheaaieon/e9f941a221014176afb323488a78fd57.delta 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpheaaieon/e9f941a221014176afb323488a78fd57.delta 1073741824" returned: 0 in 0.057s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:00 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 16:25:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73627) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 26 16:25:00 user nova-compute[73627]: INFO nova.virt.libvirt.host [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] UEFI support detected
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Successfully updated port: c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-752ef56c-750d-49b0-bcb6-0a5ab304397f req-ec75bad1-4757-49b6-884d-97a81726e228 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-changed-ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-752ef56c-750d-49b0-bcb6-0a5ab304397f req-ec75bad1-4757-49b6-884d-97a81726e228 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing instance network info cache due to event network-changed-ad329dfb-604d-4430-8b10-787465b4cc8d. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-752ef56c-750d-49b0-bcb6-0a5ab304397f req-ec75bad1-4757-49b6-884d-97a81726e228 service nova] Acquiring lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-752ef56c-750d-49b0-bcb6-0a5ab304397f req-ec75bad1-4757-49b6-884d-97a81726e228 service nova] Acquired lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-752ef56c-750d-49b0-bcb6-0a5ab304397f req-ec75bad1-4757-49b6-884d-97a81726e228 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing network info cache for port ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-752ef56c-750d-49b0-bcb6-0a5ab304397f req-ec75bad1-4757-49b6-884d-97a81726e228 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:25:00 user nova-compute[73627]: INFO nova.compute.manager [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Rescuing
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquired lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-752ef56c-750d-49b0-bcb6-0a5ab304397f req-ec75bad1-4757-49b6-884d-97a81726e228 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-752ef56c-750d-49b0-bcb6-0a5ab304397f req-ec75bad1-4757-49b6-884d-97a81726e228 service nova] Releasing lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully updated port: 7ff6530f-236c-4e59-b361-36cbc188b9f7 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquired lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] COPY block job progress, current cursor: 1179648 final cursor: 75563008 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-changed-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing instance network info cache due to event network-changed-e0e633e2-4663-405f-a0f4-b9dc5b3712a9. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] Acquiring lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] Acquired lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing network info cache for port e0e633e2-4663-405f-a0f4-b9dc5b3712a9 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.network.neutron [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Updating instance_info_cache with network_info: [{"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] Releasing lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-changed-7ff6530f-236c-4e59-b361-36cbc188b9f7 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing instance network info cache due to event network-changed-7ff6530f-236c-4e59-b361-36cbc188b9f7. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] Acquiring lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] Acquired lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing network info cache for port 7ff6530f-236c-4e59-b361-36cbc188b9f7 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Releasing lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:25:01 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpheaaieon/e9f941a221014176afb323488a78fd57.delta /opt/stack/data/nova/instances/snapshots/tmpheaaieon/e9f941a221014176afb323488a78fd57 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-2594f56b-9c8b-4547-ac58-3979e96675bc req-4c475c15-e1b3-43a1-9856-5b8336b5f9fb service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-unplugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2594f56b-9c8b-4547-ac58-3979e96675bc req-4c475c15-e1b3-43a1-9856-5b8336b5f9fb service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2594f56b-9c8b-4547-ac58-3979e96675bc req-4c475c15-e1b3-43a1-9856-5b8336b5f9fb service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2594f56b-9c8b-4547-ac58-3979e96675bc req-4c475c15-e1b3-43a1-9856-5b8336b5f9fb service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-2594f56b-9c8b-4547-ac58-3979e96675bc req-4c475c15-e1b3-43a1-9856-5b8336b5f9fb service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-unplugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:02 user nova-compute[73627]: WARNING nova.compute.manager [req-2594f56b-9c8b-4547-ac58-3979e96675bc req-4c475c15-e1b3-43a1-9856-5b8336b5f9fb service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received unexpected event network-vif-unplugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with vm_state active and task_state rescuing.
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpheaaieon/e9f941a221014176afb323488a78fd57.delta /opt/stack/data/nova/instances/snapshots/tmpheaaieon/e9f941a221014176afb323488a78fd57" returned: 0 in 0.433s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:02 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Snapshot extracted, beginning image upload
Aug 26 16:25:02 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Instance destroyed successfully.
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:02 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Attempting rescue
Aug 26 16:25:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73627) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully updated port: fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Instance directory exists: not creating {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 16:25:02 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Creating image(s)
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG nova.objects.instance [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'trusted_certs' on Instance uuid a6f68ea4-789d-4456-a82d-d067384b566b {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c1f4c9f-3618-4be5-832a-01833c4b2da3 req-ace12a37-521e-4024-b8c8-3a3d24ede2da service nova] Releasing lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:02 user nova-compute[73627]: INFO nova.virt.block_device [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Booting with volume c30dde7b-4560-4014-947f-77034a17e57f at /dev/vdb
Aug 26 16:25:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-changed-c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing instance network info cache due to event network-changed-c76ad503-8a97-4627-a8a7-46bc2f3e2055. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] Acquiring lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG os_brick.utils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lazy-loading 'flavor' on Instance uuid 09d293f0-0c31-4d11-8ba3-b6e2e4881c42 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[34068bc4-955c-4df2-8c37-bcf16d93b39f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.245s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[977603e5-e038-42c8-a494-da051ed0c9c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue" returned: 0 in 0.147s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.191s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[161f6d12-8a8e-4988-a5c6-e67a2b33baa5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.402s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG nova.objects.instance [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'migration_context' on Instance uuid a6f68ea4-789d-4456-a82d-d067384b566b {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[577326d9-2bce-4824-a4f3-e8380b2f25cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.objects.base [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<a6f68ea4-789d-4456-a82d-d067384b566b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Start _get_guest_xml network_info=[{"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "vif_mac": "fa:16:3e:89:b1:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.objects.instance [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'resources' on Instance uuid a6f68ea4-789d-4456-a82d-d067384b566b {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:03 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a8a868-7714-41f2-988d-8f2d8b415b2b]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG os_brick.utils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] <== get_connector_properties: return (307ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating existing volume attachment record: fdeef3e5-869b-4ee2-a478-dadf1bbf0167 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.objects.base [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<a6f68ea4-789d-4456-a82d-d067384b566b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.objects.instance [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'numa_topology' on Instance uuid a6f68ea4-789d-4456-a82d-d067384b566b {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.objects.base [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<a6f68ea4-789d-4456-a82d-d067384b566b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:03 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:25:03 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.objects.instance [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6f68ea4-789d-4456-a82d-d067384b566b {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:03 user nova-compute[73627]: INFO nova.compute.manager [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Attaching volume a13c79f5-0fe8-4787-a1be-daf56c877f7a to /dev/vdb
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.objects.base [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<a6f68ea4-789d-4456-a82d-d067384b566b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-167969385',display_name='tempest-ServerRescueNegativeTestJSON-server-167969385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-167969385',id=4,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-atgh31tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:30Z,user_data=None,user_id='acdf029015a64f89aa51e6559e0f962c',uuid=a6f68ea4-789d-4456-a82d-d067384b566b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "vif_mac": "fa:16:3e:89:b1:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "vif_mac": "fa:16:3e:89:b1:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:b1:c3,bridge_name='br-int',has_traffic_filtering=True,id=afd1a924-cb15-439a-b687-1dde16f591d5,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd1a924-cb') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.objects.instance [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'pci_devices' on Instance uuid a6f68ea4-789d-4456-a82d-d067384b566b {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.objects.base [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<a6f68ea4-789d-4456-a82d-d067384b566b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:25:03 user nova-compute[73627]:   <uuid>a6f68ea4-789d-4456-a82d-d067384b566b</uuid>
Aug 26 16:25:03 user nova-compute[73627]:   <name>instance-00000004</name>
Aug 26 16:25:03 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:25:03 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:25:03 user nova-compute[73627]:   <metadata>
Aug 26 16:25:03 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:25:03 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:25:03 user nova-compute[73627]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-167969385</nova:name>
Aug 26 16:25:03 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:25:03</nova:creationTime>
Aug 26 16:25:03 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:25:03 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:25:03 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:25:03 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:25:03 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:25:03 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:25:03 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:25:03 user nova-compute[73627]:       <nova:owner>
Aug 26 16:25:03 user nova-compute[73627]:         <nova:user uuid="acdf029015a64f89aa51e6559e0f962c">tempest-ServerRescueNegativeTestJSON-1187038007-project-member</nova:user>
Aug 26 16:25:03 user nova-compute[73627]:         <nova:project uuid="9f6269e1e9de40b5a5b295651a6fd9b3">tempest-ServerRescueNegativeTestJSON-1187038007</nova:project>
Aug 26 16:25:03 user nova-compute[73627]:       </nova:owner>
Aug 26 16:25:03 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:25:03 user nova-compute[73627]:       <nova:ports>
Aug 26 16:25:03 user nova-compute[73627]:         <nova:port uuid="afd1a924-cb15-439a-b687-1dde16f591d5">
Aug 26 16:25:03 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 16:25:03 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:03 user nova-compute[73627]:       </nova:ports>
Aug 26 16:25:03 user nova-compute[73627]:     </nova:instance>
Aug 26 16:25:03 user nova-compute[73627]:   </metadata>
Aug 26 16:25:03 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:25:03 user nova-compute[73627]:     <system>
Aug 26 16:25:03 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:25:03 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:25:03 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:25:03 user nova-compute[73627]:       <entry name="serial">a6f68ea4-789d-4456-a82d-d067384b566b</entry>
Aug 26 16:25:03 user nova-compute[73627]:       <entry name="uuid">a6f68ea4-789d-4456-a82d-d067384b566b</entry>
Aug 26 16:25:03 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:25:03 user nova-compute[73627]:     </system>
Aug 26 16:25:03 user nova-compute[73627]:   </sysinfo>
Aug 26 16:25:03 user nova-compute[73627]:   <os>
Aug 26 16:25:03 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:25:03 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:25:03 user nova-compute[73627]:   </os>
Aug 26 16:25:03 user nova-compute[73627]:   <features>
Aug 26 16:25:03 user nova-compute[73627]:     <acpi/>
Aug 26 16:25:03 user nova-compute[73627]:     <apic/>
Aug 26 16:25:03 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:25:03 user nova-compute[73627]:   </features>
Aug 26 16:25:03 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:25:03 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:25:03 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:25:03 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:25:03 user nova-compute[73627]:   </clock>
Aug 26 16:25:03 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:25:03 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:25:03 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:25:03 user nova-compute[73627]:   </cpu>
Aug 26 16:25:03 user nova-compute[73627]:   <devices>
Aug 26 16:25:03 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:25:03 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:25:03 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue"/>
Aug 26 16:25:03 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:25:03 user nova-compute[73627]:     </disk>
Aug 26 16:25:03 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:25:03 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:25:03 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk"/>
Aug 26 16:25:03 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:25:03 user nova-compute[73627]:     </disk>
Aug 26 16:25:03 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:03 user nova-compute[73627]:       <mac address="fa:16:3e:89:b1:c3"/>
Aug 26 16:25:03 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:03 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:03 user nova-compute[73627]:       <target dev="tapafd1a924-cb"/>
Aug 26 16:25:03 user nova-compute[73627]:     </interface>
Aug 26 16:25:03 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:25:03 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/console.log" append="off"/>
Aug 26 16:25:03 user nova-compute[73627]:     </serial>
Aug 26 16:25:03 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:25:03 user nova-compute[73627]:     <video>
Aug 26 16:25:03 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:03 user nova-compute[73627]:     </video>
Aug 26 16:25:03 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:25:03 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:25:03 user nova-compute[73627]:     </rng>
Aug 26 16:25:03 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:25:03 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:25:03 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:25:03 user nova-compute[73627]:     </memballoon>
Aug 26 16:25:03 user nova-compute[73627]:   </devices>
Aug 26 16:25:03 user nova-compute[73627]: </domain>
Aug 26 16:25:03 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:25:03 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Instance destroyed successfully.
Aug 26 16:25:03 user nova-compute[73627]: DEBUG os_brick.utils [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d2af70-e2bc-4d23-96eb-e71edb223efe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No VIF found with MAC fa:16:3e:89:b1:c3, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[22549c85-fa0d-4bce-9449-463e7dd2845d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f560bc-83c9-4c38-824e-50fad9526a27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f42858-6803-4a2a-9a58-fd178d24560c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully updated port: 89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:03 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b672a05a-1599-402c-9cb5-876d9aa58168]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG os_brick.utils [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Updating existing volume attachment record: 0bb2bd85-74c8-4cef-9cb9-8afddec8a09f {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:25:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-ccc3bf64-bb81-4383-aaea-bf136751491c req-0a438429-719f-4036-bd9e-b43b599c6357 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ccc3bf64-bb81-4383-aaea-bf136751491c req-0a438429-719f-4036-bd9e-b43b599c6357 service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ccc3bf64-bb81-4383-aaea-bf136751491c req-0a438429-719f-4036-bd9e-b43b599c6357 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ccc3bf64-bb81-4383-aaea-bf136751491c req-0a438429-719f-4036-bd9e-b43b599c6357 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-ccc3bf64-bb81-4383-aaea-bf136751491c req-0a438429-719f-4036-bd9e-b43b599c6357 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:04 user nova-compute[73627]: WARNING nova.compute.manager [req-ccc3bf64-bb81-4383-aaea-bf136751491c req-0a438429-719f-4036-bd9e-b43b599c6357 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received unexpected event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with vm_state active and task_state rescuing.
Aug 26 16:25:04 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:25:04 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=6704MB free_disk=25.648113250732422GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully updated port: 0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 09d293f0-0c31-4d11-8ba3-b6e2e4881c42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 401459e7-47f6-466a-847f-01c92022bb56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 3b4253a4-1436-4026-8549-f48f1bb8f121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 95c10a06-6846-4106-9c43-37054de6bf94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f34a8233-5a54-4a28-b57f-096e8526e80e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f961b797-16bd-43bd-8735-93578f1084cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-changed-89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing instance network info cache due to event network-changed-89f0db97-51c1-44f3-8009-1624dfa94db4. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] Acquiring lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] Acquired lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing network info cache for port 89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] Releasing lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-changed-0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing instance network info cache due to event network-changed-0417fa30-6f31-4ecb-a6e4-a25accad0428. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] Acquiring lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] Acquired lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing network info cache for port 0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [{"id": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "address": "fa:16:3e:5e:97:1a", "network": {"id": "b9e80f57-f3a7-4dea-baa9-0c731b953efe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1451618830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adc995e-54", "ovs_interfaceid": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.939s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Releasing lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Instance network_info: |[{"id": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "address": "fa:16:3e:5e:97:1a", "network": {"id": "b9e80f57-f3a7-4dea-baa9-0c731b953efe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1451618830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adc995e-54", "ovs_interfaceid": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] Acquired lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing network info cache for port c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:25:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Snapshot image upload complete
Aug 26 16:25:05 user nova-compute[73627]: INFO nova.compute.manager [None req-1558ee4e-2431-4560-946c-70753ab66870 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Took 6.58 seconds to snapshot the instance on the hypervisor.
Aug 26 16:25:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bf557149-b0f0-4b3c-84bc-e1ca883cacd7 req-04915fc3-da09-4340-bca8-10528d427fc0 service nova] Releasing lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Successfully updated port: 60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquired lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.network.neutron [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updated VIF entry in instance network info cache for port c76ad503-8a97-4627-a8a7-46bc2f3e2055. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.network.neutron [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [{"id": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "address": "fa:16:3e:5e:97:1a", "network": {"id": "b9e80f57-f3a7-4dea-baa9-0c731b953efe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1451618830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adc995e-54", "ovs_interfaceid": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] Releasing lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-changed-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing instance network info cache due to event network-changed-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] Acquiring lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:06 user nova-compute[73627]: WARNING nova.compute.manager [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received unexpected event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with vm_state active and task_state rescuing.
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:06 user nova-compute[73627]: WARNING nova.compute.manager [req-27347932-9fca-4331-bf51-720a92637abf req-1585fdf4-1270-461a-ad12-2e26e1ecbcb6 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received unexpected event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with vm_state active and task_state rescuing.
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-5f50f342-f3b3-4869-8d8c-cb32ada54d4d req-c44267c2-3689-47ac-a92b-6adbb5391e6d service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-changed-60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-5f50f342-f3b3-4869-8d8c-cb32ada54d4d req-c44267c2-3689-47ac-a92b-6adbb5391e6d service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing instance network info cache due to event network-changed-60158f05-7509-4976-85e8-fdeff3b26a24. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5f50f342-f3b3-4869-8d8c-cb32ada54d4d req-c44267c2-3689-47ac-a92b-6adbb5391e6d service nova] Acquiring lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Updating instance_info_cache with network_info: [{"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Removed pending event for a6f68ea4-789d-4456-a82d-d067384b566b due to event {{(pid=73627) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067107.488623, a6f68ea4-789d-4456-a82d-d067384b566b => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:25:07 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] VM Resumed (Lifecycle Event)
Aug 26 16:25:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-83f799bb-4bab-42d0-a86c-c87c8d4bbb2f tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:25:07 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 16:25:07 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067107.490481, a6f68ea4-789d-4456-a82d-d067384b566b => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:25:07 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] VM Started (Lifecycle Event)
Aug 26 16:25:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:25:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:25:08 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [{"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Releasing lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:08 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Instance network_info: |[{"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:25:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] Acquired lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:08 user nova-compute[73627]: DEBUG nova.network.neutron [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing network info cache for port fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updated VIF entry in instance network info cache for port fb075d9c-38a0-4fe7-a3ad-3ccd4db43646. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:25:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [{"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b0814bba-424c-4ec4-8380-2e189e4553cf req-bacb7b06-cd5a-469a-8f31-1d38e5ce597e service nova] Releasing lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5f50f342-f3b3-4869-8d8c-cb32ada54d4d req-c44267c2-3689-47ac-a92b-6adbb5391e6d service nova] Acquired lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-5f50f342-f3b3-4869-8d8c-cb32ada54d4d req-c44267c2-3689-47ac-a92b-6adbb5391e6d service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing network info cache for port 60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-5f50f342-f3b3-4869-8d8c-cb32ada54d4d req-c44267c2-3689-47ac-a92b-6adbb5391e6d service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updated VIF entry in instance network info cache for port 60158f05-7509-4976-85e8-fdeff3b26a24. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:25:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-5f50f342-f3b3-4869-8d8c-cb32ada54d4d req-c44267c2-3689-47ac-a92b-6adbb5391e6d service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [{"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5f50f342-f3b3-4869-8d8c-cb32ada54d4d req-c44267c2-3689-47ac-a92b-6adbb5391e6d service nova] Releasing lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:11 user nova-compute[73627]: INFO nova.virt.block_device [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Booting with volume f4d03986-90cc-44b3-a12a-345b32664c19 at /dev/vdb
Aug 26 16:25:11 user nova-compute[73627]: DEBUG os_brick.utils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bd3cf6-77be-426c-bf88-d59acd492c14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b2a351-41ea-421a-a514-3ea66b0452ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6103b157-341b-45b0-ad9a-ebd4117afdfa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[215cb9fa-3348-4bd0-8455-eb4e1cf5e18f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:11 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:25:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[357e07f2-5c64-4f45-8fc2-854fe18fe1c5]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG os_brick.utils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:11 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating existing volume attachment record: 2ae4c936-8b1f-45d9-a5aa-5ee770e1dfd5 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:25:13 user nova-compute[73627]: DEBUG nova.compute.manager [req-ed8fbda8-1527-4c8e-8883-e86268b39b53 req-6b588b2c-e0c9-41e6-b5d3-ba92ac5f3827 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Received event network-changed-7b47c648-cab6-43bb-bae0-85a3690cb4ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:13 user nova-compute[73627]: DEBUG nova.compute.manager [req-ed8fbda8-1527-4c8e-8883-e86268b39b53 req-6b588b2c-e0c9-41e6-b5d3-ba92ac5f3827 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Refreshing instance network info cache due to event network-changed-7b47c648-cab6-43bb-bae0-85a3690cb4ea. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ed8fbda8-1527-4c8e-8883-e86268b39b53 req-6b588b2c-e0c9-41e6-b5d3-ba92ac5f3827 service nova] Acquiring lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ed8fbda8-1527-4c8e-8883-e86268b39b53 req-6b588b2c-e0c9-41e6-b5d3-ba92ac5f3827 service nova] Acquired lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:13 user nova-compute[73627]: DEBUG nova.network.neutron [req-ed8fbda8-1527-4c8e-8883-e86268b39b53 req-6b588b2c-e0c9-41e6-b5d3-ba92ac5f3827 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Refreshing network info cache for port 7b47c648-cab6-43bb-bae0-85a3690cb4ea {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:14 user nova-compute[73627]: DEBUG nova.network.neutron [req-ed8fbda8-1527-4c8e-8883-e86268b39b53 req-6b588b2c-e0c9-41e6-b5d3-ba92ac5f3827 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Updated VIF entry in instance network info cache for port 7b47c648-cab6-43bb-bae0-85a3690cb4ea. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:25:14 user nova-compute[73627]: DEBUG nova.network.neutron [req-ed8fbda8-1527-4c8e-8883-e86268b39b53 req-6b588b2c-e0c9-41e6-b5d3-ba92ac5f3827 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Updating instance_info_cache with network_info: [{"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ed8fbda8-1527-4c8e-8883-e86268b39b53 req-6b588b2c-e0c9-41e6-b5d3-ba92ac5f3827 service nova] Releasing lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:15 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:25:15 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXVBazAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:15 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:15 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:15 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:15 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:15 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:15 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:15 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: INFO nova.virt.block_device [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Booting with volume cfd34708-26e7-4e70-9268-9713314c6f84 at /dev/vdc
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[297be9e9-d5ff-443b-8eb0-009dd8344b8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:25:16 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[59303c3b-8a8a-470a-ba9c-73c46c29f264]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a] added
Aug 26 16:25:16 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.utils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a396130-e83e-47e1-a489-271da3b419ec]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a336393-ece6-46ab-9eed-8a415c2a3b9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d2283e-b742-49cd-9c98-0afd6ef0b936]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXVBazAm {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7e291d-0c77-4430-b2a7-698bed9a1c01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXVBazAm" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[87851e06-0945-4349-94dd-7b281882f39e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FXVBazAm'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[904aea6d-af89-4c69-adfa-1a95793fd45f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5390256c-0d34-46bd-a7b0-de61ac99389d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c973c25f-568a-4243-840f-93635240ef93]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:16 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f94f5e-67d5-48be-bea0-7ab62251b58c]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.utils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating existing volume attachment record: cfe7e836-7de3-49f7-855f-dc008bc17dae {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b397d58-8e86-44ca-abed-b01d6bf41c1f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:16 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:16 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe41af85-e9f8-4b4d-bfea-49fea06cfefc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a, portal: 172.16.0.220,3260]
Aug 26 16:25:16 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a, portal: 172.16.0.220,3260] successful.
Aug 26 16:25:16 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb3dc82-2455-4675-9e86-95d491e563d6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[212c8e1b-873b-4455-9361-ea499fb13fb3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:16 user nova-compute[73627]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a (non-flash)
Aug 26 16:25:16 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:16 user nova-compute[73627]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a (non-flash)
Aug 26 16:25:16 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[856b04c0-997c-4d26-a3ec-49aa9e09a85e]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:25:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXVBazAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:25:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23538306535366139', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538306535366139', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:25:17 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lazy-loading 'flavor' on Instance uuid 09d293f0-0c31-4d11-8ba3-b6e2e4881c42 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:25:17 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:25:17 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:25:17 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:25:17 user nova-compute[73627]:   <serial>a13c79f5-0fe8-4787-a1be-daf56c877f7a</serial>
Aug 26 16:25:17 user nova-compute[73627]: </disk>
Aug 26 16:25:17 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:25:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] No VIF found with MAC fa:16:3e:14:39:70, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:25:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7f95de65-4aa4-4de0-9633-4c747f8b179e tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.824s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:18 user nova-compute[73627]: INFO nova.compute.manager [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Terminating instance
Aug 26 16:25:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-cdd7b4d4-aae3-45ca-9bce-c22bd3b1fd86 req-4ab4cba6-993d-4ca6-85f9-0cf3697f9d71 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-vif-unplugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cdd7b4d4-aae3-45ca-9bce-c22bd3b1fd86 req-4ab4cba6-993d-4ca6-85f9-0cf3697f9d71 service nova] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cdd7b4d4-aae3-45ca-9bce-c22bd3b1fd86 req-4ab4cba6-993d-4ca6-85f9-0cf3697f9d71 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cdd7b4d4-aae3-45ca-9bce-c22bd3b1fd86 req-4ab4cba6-993d-4ca6-85f9-0cf3697f9d71 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-cdd7b4d4-aae3-45ca-9bce-c22bd3b1fd86 req-4ab4cba6-993d-4ca6-85f9-0cf3697f9d71 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] No waiting events found dispatching network-vif-unplugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-cdd7b4d4-aae3-45ca-9bce-c22bd3b1fd86 req-4ab4cba6-993d-4ca6-85f9-0cf3697f9d71 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-vif-unplugged-4905f341-d7d6-47da-b6b2-1dd43d93133d for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Instance destroyed successfully.
Aug 26 16:25:19 user nova-compute[73627]: DEBUG nova.objects.instance [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lazy-loading 'resources' on Instance uuid 09d293f0-0c31-4d11-8ba3-b6e2e4881c42 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-534747565',display_name='tempest-DeleteServersTestJSON-server-534747565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-534747565',id=1,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43cbe040c162469897bb683eeff4d543',ramdisk_id='',reservation_id='r-085whfu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1234185935',owner_user_name='tempest-DeleteServersTestJSON-1234185935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:23:30Z,user_data=None,user_id='cff4ef247a7f4742bf3e9d52f13f8a3b',uuid=09d293f0-0c31-4d11-8ba3-b6e2e4881c42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "address": "fa:16:3e:14:39:70", "network": {"id": "1a393b72-2045-4ad2-b823-8dd0a0239bf5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2041643108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43cbe040c162469897bb683eeff4d543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4905f341-d7", "ovs_interfaceid": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Converting VIF {"id": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "address": "fa:16:3e:14:39:70", "network": {"id": "1a393b72-2045-4ad2-b823-8dd0a0239bf5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2041643108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43cbe040c162469897bb683eeff4d543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4905f341-d7", "ovs_interfaceid": "4905f341-d7d6-47da-b6b2-1dd43d93133d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:39:70,bridge_name='br-int',has_traffic_filtering=True,id=4905f341-d7d6-47da-b6b2-1dd43d93133d,network=Network(1a393b72-2045-4ad2-b823-8dd0a0239bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4905f341-d7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG os_vif [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:39:70,bridge_name='br-int',has_traffic_filtering=True,id=4905f341-d7d6-47da-b6b2-1dd43d93133d,network=Network(1a393b72-2045-4ad2-b823-8dd0a0239bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4905f341-d7') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4905f341-d7, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:19 user nova-compute[73627]: INFO os_vif [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:39:70,bridge_name='br-int',has_traffic_filtering=True,id=4905f341-d7d6-47da-b6b2-1dd43d93133d,network=Network(1a393b72-2045-4ad2-b823-8dd0a0239bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4905f341-d7')
Aug 26 16:25:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXVBazAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:19 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcef890e-4659-47bd-af96-6e308bf18c68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fc0e5f-829c-4153-ac2d-4a9d84b84650]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:19 user nova-compute[73627]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a (non-flash)
Aug 26 16:25:19 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:19 user nova-compute[73627]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a (non-flash)
Aug 26 16:25:19 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e82c7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1608c988-db47-4e79-a9a1-ceec366322b5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[040c18de-8cdb-473a-bd9d-76fec011563a]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a32ffb8-7c25-446e-9ddb-6bbb0dae88f6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f32eac-1e2b-4898-b065-fe8e14b1cfcb]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f26678-5e01-4bc5-bde3-f0d30e7e89a1]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d89a450-46ff-41e9-bc6e-825674744c32]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a, portal: 172.16.0.220,3260]
Aug 26 16:25:20 user nova-compute[73627]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a, portal: 172.16.0.220,3260] successful.
Aug 26 16:25:20 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a13c79f5-0fe8-4787-a1be-daf56c877f7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0144aa1f-4db5-4843-9dc9-5f4c722a713c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] <== disconnect_volume: return (339ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:25:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Deleting instance files /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42_del
Aug 26 16:25:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Deletion of /opt/stack/data/nova/instances/09d293f0-0c31-4d11-8ba3-b6e2e4881c42_del complete
Aug 26 16:25:20 user nova-compute[73627]: INFO nova.compute.manager [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'flavor' on Instance uuid eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:20 user nova-compute[73627]: INFO nova.compute.manager [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Attaching volume 3387ec47-b471-4c68-a7bf-2129fa41edc9 to /dev/vdb
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.utils [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0cb58e-7ee5-4fb8-bef6-70aaf075ce59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b5693b-24fd-4eb5-ae33-1a9c0e924363]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3812a180-a966-4825-b946-0b3f5212c0ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cb02cd-983a-471e-aebb-6214ad5263f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:20 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:25:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e24833d-7ea4-4ec9-9f6c-131ee55f25cc]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG os_brick.utils [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:20 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Updating existing volume attachment record: a7069322-45ac-4497-97f2-4a0e4f0633fb {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-95ecae2b-3f1b-4d71-acc1-04b4c84b5d9f req-7407d142-0bcf-4295-8b40-a93736c835d5 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-vif-deleted-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:21 user nova-compute[73627]: INFO nova.compute.manager [req-95ecae2b-3f1b-4d71-acc1-04b4c84b5d9f req-7407d142-0bcf-4295-8b40-a93736c835d5 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Neutron deleted interface 4905f341-d7d6-47da-b6b2-1dd43d93133d; detaching it from the instance and deleting it from the info cache
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-95ecae2b-3f1b-4d71-acc1-04b4c84b5d9f req-7407d142-0bcf-4295-8b40-a93736c835d5 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:21 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Took 0.76 seconds to deallocate network for instance.
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-95ecae2b-3f1b-4d71-acc1-04b4c84b5d9f req-7407d142-0bcf-4295-8b40-a93736c835d5 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Detach interface failed, port_id=4905f341-d7d6-47da-b6b2-1dd43d93133d, reason: Instance 09d293f0-0c31-4d11-8ba3-b6e2e4881c42 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] No waiting events found dispatching network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:21 user nova-compute[73627]: WARNING nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received unexpected event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d for instance with vm_state active and task_state deleting.
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] No waiting events found dispatching network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:21 user nova-compute[73627]: WARNING nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received unexpected event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d for instance with vm_state active and task_state deleting.
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] No waiting events found dispatching network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:21 user nova-compute[73627]: WARNING nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received unexpected event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d for instance with vm_state active and task_state deleting.
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-vif-unplugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] No waiting events found dispatching network-vif-unplugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-vif-unplugged-4905f341-d7d6-47da-b6b2-1dd43d93133d for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Acquiring lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] No waiting events found dispatching network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:21 user nova-compute[73627]: WARNING nova.compute.manager [req-dd0f21cc-8ccf-4135-bc65-61db7ccd5949 req-c66b8446-96b5-4d22-b027-a939402da890 service nova] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Received unexpected event network-vif-plugged-4905f341-d7d6-47da-b6b2-1dd43d93133d for instance with vm_state active and task_state deleting.
Aug 26 16:25:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-8497eccb-c843-4cdd-865b-32a545d5ac2d req-8def9e3a-f4dc-4759-94a2-892cccc07fa3 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Received event network-changed-e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-8497eccb-c843-4cdd-865b-32a545d5ac2d req-8def9e3a-f4dc-4759-94a2-892cccc07fa3 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Refreshing instance network info cache due to event network-changed-e70e03b5-2564-4008-b416-306d76ad521c. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8497eccb-c843-4cdd-865b-32a545d5ac2d req-8def9e3a-f4dc-4759-94a2-892cccc07fa3 service nova] Acquiring lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8497eccb-c843-4cdd-865b-32a545d5ac2d req-8def9e3a-f4dc-4759-94a2-892cccc07fa3 service nova] Acquired lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:27 user nova-compute[73627]: DEBUG nova.network.neutron [req-8497eccb-c843-4cdd-865b-32a545d5ac2d req-8def9e3a-f4dc-4759-94a2-892cccc07fa3 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Refreshing network info cache for port e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:27 user nova-compute[73627]: DEBUG nova.network.neutron [req-8497eccb-c843-4cdd-865b-32a545d5ac2d req-8def9e3a-f4dc-4759-94a2-892cccc07fa3 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Updated VIF entry in instance network info cache for port e70e03b5-2564-4008-b416-306d76ad521c. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:25:27 user nova-compute[73627]: DEBUG nova.network.neutron [req-8497eccb-c843-4cdd-865b-32a545d5ac2d req-8def9e3a-f4dc-4759-94a2-892cccc07fa3 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Updating instance_info_cache with network_info: [{"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8497eccb-c843-4cdd-865b-32a545d5ac2d req-8def9e3a-f4dc-4759-94a2-892cccc07fa3 service nova] Releasing lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-214507e4-b188-4d7c-bb16-f29b02b59d4c req-e3956642-f93b-4c19-96a8-270bf68d6362 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-changed-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-214507e4-b188-4d7c-bb16-f29b02b59d4c req-e3956642-f93b-4c19-96a8-270bf68d6362 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Refreshing instance network info cache due to event network-changed-8460694d-a04c-490a-99d0-2c84dac1ecb2. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-214507e4-b188-4d7c-bb16-f29b02b59d4c req-e3956642-f93b-4c19-96a8-270bf68d6362 service nova] Acquiring lock "refresh_cache-401459e7-47f6-466a-847f-01c92022bb56" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-214507e4-b188-4d7c-bb16-f29b02b59d4c req-e3956642-f93b-4c19-96a8-270bf68d6362 service nova] Acquired lock "refresh_cache-401459e7-47f6-466a-847f-01c92022bb56" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:28 user nova-compute[73627]: DEBUG nova.network.neutron [req-214507e4-b188-4d7c-bb16-f29b02b59d4c req-e3956642-f93b-4c19-96a8-270bf68d6362 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Refreshing network info cache for port 8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:29 user nova-compute[73627]: DEBUG nova.network.neutron [req-214507e4-b188-4d7c-bb16-f29b02b59d4c req-e3956642-f93b-4c19-96a8-270bf68d6362 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Updated VIF entry in instance network info cache for port 8460694d-a04c-490a-99d0-2c84dac1ecb2. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:25:29 user nova-compute[73627]: DEBUG nova.network.neutron [req-214507e4-b188-4d7c-bb16-f29b02b59d4c req-e3956642-f93b-4c19-96a8-270bf68d6362 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Updating instance_info_cache with network_info: [{"id": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "address": "fa:16:3e:3f:e1:88", "network": {"id": "90399b68-638c-4049-a4be-633201cdae4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-176014943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d458207e23cf4a2384c64470098cd200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8460694d-a0", "ovs_interfaceid": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-214507e4-b188-4d7c-bb16-f29b02b59d4c req-e3956642-f93b-4c19-96a8-270bf68d6362 service nova] Releasing lock "refresh_cache-401459e7-47f6-466a-847f-01c92022bb56" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:31 user nova-compute[73627]: INFO nova.virt.block_device [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Booting with volume d7c23dce-9a2f-4659-a509-c67bcf9060f5 at /dev/vdc
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:25:32 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Creating image(s)
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Ensure instance console log exists: /opt/stack/data/nova/instances/6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Start _get_guest_xml network_info=[{"id": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "address": "fa:16:3e:5e:97:1a", "network": {"id": "b9e80f57-f3a7-4dea-baa9-0c731b953efe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1451618830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adc995e-54", "ovs_interfaceid": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkSOWxKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9', 'attached_at': '', 'detached_at': '', 'volume_id': '2046ca53-76ca-4a65-a4af-48a244aec175', 'serial': '2046ca53-76ca-4a65-a4af-48a244aec175'}, 'guest_format': None, 'attachment_id': 'c7f77cea-cd04-4714-b3f6-ba1e7ac70ebb', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZJGMRDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9', 'attached_at': '', 'detached_at': '', 'volume_id': 'c30dde7b-4560-4014-947f-77034a17e57f', 'serial': 'c30dde7b-4560-4014-947f-77034a17e57f'}, 'guest_format': None, 'attachment_id': 'fdeef3e5-869b-4ee2-a478-dadf1bbf0167', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNemdLRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9', 'attached_at': '', 'detached_at': '', 'volume_id': 'cfd34708-26e7-4e70-9268-9713314c6f84', 'serial': 'cfd34708-26e7-4e70-9268-9713314c6f84'}, 'guest_format': None, 'attachment_id': 'cfe7e836-7de3-49f7-855f-dc008bc17dae', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:25:32 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:25:32 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkSOWxKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:32 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:32 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:32 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.utils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fdf3c0-cb08-407d-8c46-fd45b5227113]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:25:32 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d462be14-6c49-4cb1-b396-d1da8fe94cd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b36e93-60ef-4f51-9712-74f695b8cc93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175] added
Aug 26 16:25:32 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76dc17c-8bad-4726-979b-ab1f03aa4fda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc87549-e0a1-40d7-a20b-da4c584ee290]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d7d187-a5e2-4f3c-8920-cba05ae46ead]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8cb650-22aa-4b1f-bc3e-c8a7a9550c9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0921bbf4-fbd7-43b7-8cfa-14357c637c6e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LkSOWxKG {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:32 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99973f1-a496-4565-91e1-91aef7511ce0]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.utils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating existing volume attachment record: 2d5fa06d-4600-430d-a40e-84e5ae9907b5 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LkSOWxKG" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfc962b-1d4b-45cb-84ee-f0fa90276466]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LkSOWxKG'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b5a8e4-eda8-40ab-bbcf-5c1869d2d10f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[29610e2e-baee-4ac6-80e3-8994db0c62bd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:32 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:32 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ad3201-c819-4fe3-b39c-b44baf0b30e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175, portal: 172.16.0.220,3260]
Aug 26 16:25:32 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175, portal: 172.16.0.220,3260] successful.
Aug 26 16:25:32 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bc4bb9-3c40-4e1c-b7ce-d2099bc4a4da]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9823a4-fdcb-4daf-be8f-9abedb9d3e0b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:32 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:32 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:32 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:32 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a161460-4b2b-44a8-856b-b2ae5d365725]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:32 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkSOWxKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23036643931656532', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036643931656532', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZJGMRDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:33 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:33 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:33 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1d8657-1cb3-4988-a310-16e71b54939e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:25:33 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[93679279-9e92-4f37-b69d-729117b61692]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f] added
Aug 26 16:25:33 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c953d8-4ff6-41f0-87e8-970d0572ea79]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a770dbfa-b580-427d-a12e-36e178ceee82]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZJGMRDa {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZJGMRDa" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f09160-4476-4fac-b145-fc82e6dd472b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BZJGMRDa'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9845923-b821-412a-bca6-8baa3da31e57]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3946092e-848f-46b1-8f43-a2f8ed87f402]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:33 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:33 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:33 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:33 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[653608aa-7282-4733-b01e-08fdd2ea2c33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f, portal: 172.16.0.220,3260]
Aug 26 16:25:33 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f, portal: 172.16.0.220,3260] successful.
Aug 26 16:25:33 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b626f663-3d55-44e1-b33f-d7f425bee789]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[36528bdc-a19d-4dc7-a9f7-de5062f7e5ad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:33 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:33 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:33 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:33 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:33 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:33 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1224ecd-d24a-4e7c-8222-f56c56b629f8]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:25:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZJGMRDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067119.8009708, 09d293f0-0c31-4d11-8ba3-b6e2e4881c42 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:25:34 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] VM Stopped (Lifecycle Event)
Aug 26 16:25:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b8214190-3719-43ab-8737-57c23b9ccb2e None None] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26465653439633437', 'path': '/dev/sdd'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465653439633437', 'path': '/dev/sdd'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNemdLRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:34 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:34 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:34 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3fe040-c517-4cba-b40a-906c9aadf79c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:25:34 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[498577a7-ad8e-42eb-a1a3-edc732d87f9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84] added
Aug 26 16:25:34 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc16909-b4e4-42af-a4c6-d32bc801dc6c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0fbf2d-2382-48d0-b91a-2c6f0e74fdf8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNemdLRu {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNemdLRu" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[50be932b-80ae-43a7-8fdd-f397bbf73bd4]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yNemdLRu'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[164b20dd-2934-4be1-b6cd-28fccfefa3c5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d773a29-112b-48cf-8226-29805d77b111]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:35 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:35 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:35 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:35 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddcb217-bad2-4bfc-a46a-79527a01df4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84, portal: 172.16.0.220,3260]
Aug 26 16:25:35 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84, portal: 172.16.0.220,3260] successful.
Aug 26 16:25:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2f7b28-d8f9-4026-844d-0cc8a8ca0b8f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[126f7834-79bf-48a3-83a7-cc21052278eb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:35 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:35 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:35 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:35 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:35 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:35 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecbbb61-d7d0-404d-93a5-71e2b466d3a5]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:25:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNemdLRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23566386130373563', 'path': '/dev/sde'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566386130373563', 'path': '/dev/sde'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:25:36 user nova-compute[73627]: INFO nova.compute.manager [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] [instance: 09d293f0-0c31-4d11-8ba3-b6e2e4881c42] Took 15.18 seconds to detach 1 volumes for instance.
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "address": "fa:16:3e:5e:97:1a", "network": {"id": "b9e80f57-f3a7-4dea-baa9-0c731b953efe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1451618830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adc995e-54", "ovs_interfaceid": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "address": "fa:16:3e:5e:97:1a", "network": {"id": "b9e80f57-f3a7-4dea-baa9-0c731b953efe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1451618830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adc995e-54", "ovs_interfaceid": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:97:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adc995e-548e-4c77-9ce2-42abba1ddc8a,network=Network(b9e80f57-f3a7-4dea-baa9-0c731b953efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adc995e-54') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:dc:e6,bridge_name='br-int',has_traffic_filtering=True,id=8d5d4266-25e9-425f-ac4f-80fd24af6c31,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5d4266-25') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:06,bridge_name='br-int',has_traffic_filtering=True,id=1c1a1228-7701-4e82-872b-23fbde018c1d,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c1a1228-77') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:fb,bridge_name='br-int',has_traffic_filtering=True,id=a6b1395b-20a9-448b-97be-e353b593be0e,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b1395b-20') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:12:f3,bridge_name='br-int',has_traffic_filtering=True,id=c5f8ae0b-fc44-4b0f-bc7d-af523931bf04,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f8ae0b-fc') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=ad329dfb-604d-4430-8b10-787465b4cc8d,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad329dfb-60') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:7b:e0,bridge_name='br-int',has_traffic_filtering=True,id=c76ad503-8a97-4627-a8a7-46bc2f3e2055,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc76ad503-8a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:25:36 user nova-compute[73627]:   <uuid>6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9</uuid>
Aug 26 16:25:36 user nova-compute[73627]:   <name>instance-0000000c</name>
Aug 26 16:25:36 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:25:36 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:25:36 user nova-compute[73627]:   <metadata>
Aug 26 16:25:36 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:25:36 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:25:36 user nova-compute[73627]:       <nova:name>tempest-device-tagging-server-517302870</nova:name>
Aug 26 16:25:36 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:25:32</nova:creationTime>
Aug 26 16:25:36 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:25:36 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:25:36 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:25:36 user nova-compute[73627]:       <nova:owner>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:user uuid="de7ed97bdd2c487798ba4608ba5a2625">tempest-TaggedBootDevicesTest_v242-192220641-project-member</nova:user>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:project uuid="66759aba5e2e4d859ccff1255e821a64">tempest-TaggedBootDevicesTest_v242-192220641</nova:project>
Aug 26 16:25:36 user nova-compute[73627]:       </nova:owner>
Aug 26 16:25:36 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:25:36 user nova-compute[73627]:       <nova:ports>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:port uuid="9adc995e-548e-4c77-9ce2-42abba1ddc8a">
Aug 26 16:25:36 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 16:25:36 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:port uuid="8d5d4266-25e9-425f-ac4f-80fd24af6c31">
Aug 26 16:25:36 user nova-compute[73627]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Aug 26 16:25:36 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:port uuid="1c1a1228-7701-4e82-872b-23fbde018c1d">
Aug 26 16:25:36 user nova-compute[73627]:           <nova:ip type="fixed" address="10.1.1.192" ipVersion="4"/>
Aug 26 16:25:36 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:port uuid="a6b1395b-20a9-448b-97be-e353b593be0e">
Aug 26 16:25:36 user nova-compute[73627]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
Aug 26 16:25:36 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:port uuid="c5f8ae0b-fc44-4b0f-bc7d-af523931bf04">
Aug 26 16:25:36 user nova-compute[73627]:           <nova:ip type="fixed" address="10.1.1.162" ipVersion="4"/>
Aug 26 16:25:36 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:port uuid="ad329dfb-604d-4430-8b10-787465b4cc8d">
Aug 26 16:25:36 user nova-compute[73627]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 16:25:36 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:36 user nova-compute[73627]:         <nova:port uuid="c76ad503-8a97-4627-a8a7-46bc2f3e2055">
Aug 26 16:25:36 user nova-compute[73627]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 16:25:36 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:36 user nova-compute[73627]:       </nova:ports>
Aug 26 16:25:36 user nova-compute[73627]:     </nova:instance>
Aug 26 16:25:36 user nova-compute[73627]:   </metadata>
Aug 26 16:25:36 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:25:36 user nova-compute[73627]:     <system>
Aug 26 16:25:36 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:25:36 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:25:36 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:25:36 user nova-compute[73627]:       <entry name="serial">6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9</entry>
Aug 26 16:25:36 user nova-compute[73627]:       <entry name="uuid">6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9</entry>
Aug 26 16:25:36 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:25:36 user nova-compute[73627]:     </system>
Aug 26 16:25:36 user nova-compute[73627]:   </sysinfo>
Aug 26 16:25:36 user nova-compute[73627]:   <os>
Aug 26 16:25:36 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:25:36 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:25:36 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:25:36 user nova-compute[73627]:   </os>
Aug 26 16:25:36 user nova-compute[73627]:   <features>
Aug 26 16:25:36 user nova-compute[73627]:     <acpi/>
Aug 26 16:25:36 user nova-compute[73627]:     <apic/>
Aug 26 16:25:36 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:25:36 user nova-compute[73627]:   </features>
Aug 26 16:25:36 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:25:36 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:25:36 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:25:36 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:25:36 user nova-compute[73627]:   </clock>
Aug 26 16:25:36 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:25:36 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:25:36 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:25:36 user nova-compute[73627]:   </cpu>
Aug 26 16:25:36 user nova-compute[73627]:   <devices>
Aug 26 16:25:36 user nova-compute[73627]:     <disk type="file" device="cdrom">
Aug 26 16:25:36 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 16:25:36 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9/disk.config"/>
Aug 26 16:25:36 user nova-compute[73627]:       <target dev="hda" bus="ide"/>
Aug 26 16:25:36 user nova-compute[73627]:     </disk>
Aug 26 16:25:36 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:25:36 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:25:36 user nova-compute[73627]:       <source dev="/dev/sdc"/>
Aug 26 16:25:36 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:25:36 user nova-compute[73627]:       <serial>2046ca53-76ca-4a65-a4af-48a244aec175</serial>
Aug 26 16:25:36 user nova-compute[73627]:     </disk>
Aug 26 16:25:36 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:25:36 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:25:36 user nova-compute[73627]:       <source dev="/dev/sdd"/>
Aug 26 16:25:36 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:25:36 user nova-compute[73627]:       <serial>c30dde7b-4560-4014-947f-77034a17e57f</serial>
Aug 26 16:25:36 user nova-compute[73627]:     </disk>
Aug 26 16:25:36 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:25:36 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:25:36 user nova-compute[73627]:       <source dev="/dev/sde"/>
Aug 26 16:25:36 user nova-compute[73627]:       <target dev="vdc" bus="virtio"/>
Aug 26 16:25:36 user nova-compute[73627]:       <serial>cfd34708-26e7-4e70-9268-9713314c6f84</serial>
Aug 26 16:25:36 user nova-compute[73627]:     </disk>
Aug 26 16:25:36 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:36 user nova-compute[73627]:       <mac address="fa:16:3e:5e:97:1a"/>
Aug 26 16:25:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:36 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:36 user nova-compute[73627]:       <target dev="tap9adc995e-54"/>
Aug 26 16:25:36 user nova-compute[73627]:     </interface>
Aug 26 16:25:36 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:36 user nova-compute[73627]:       <mac address="fa:16:3e:e9:dc:e6"/>
Aug 26 16:25:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:36 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:36 user nova-compute[73627]:       <target dev="tap8d5d4266-25"/>
Aug 26 16:25:36 user nova-compute[73627]:     </interface>
Aug 26 16:25:36 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:36 user nova-compute[73627]:       <mac address="fa:16:3e:ce:17:06"/>
Aug 26 16:25:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:36 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:36 user nova-compute[73627]:       <target dev="tap1c1a1228-77"/>
Aug 26 16:25:36 user nova-compute[73627]:     </interface>
Aug 26 16:25:36 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:36 user nova-compute[73627]:       <mac address="fa:16:3e:e7:ff:fb"/>
Aug 26 16:25:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:36 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:36 user nova-compute[73627]:       <target dev="tapa6b1395b-20"/>
Aug 26 16:25:36 user nova-compute[73627]:     </interface>
Aug 26 16:25:36 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:36 user nova-compute[73627]:       <mac address="fa:16:3e:94:12:f3"/>
Aug 26 16:25:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:36 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:36 user nova-compute[73627]:       <target dev="tapc5f8ae0b-fc"/>
Aug 26 16:25:36 user nova-compute[73627]:     </interface>
Aug 26 16:25:36 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:36 user nova-compute[73627]:       <mac address="fa:16:3e:1d:ba:71"/>
Aug 26 16:25:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:36 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:36 user nova-compute[73627]:       <target dev="tapad329dfb-60"/>
Aug 26 16:25:36 user nova-compute[73627]:     </interface>
Aug 26 16:25:36 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:36 user nova-compute[73627]:       <mac address="fa:16:3e:88:7b:e0"/>
Aug 26 16:25:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:36 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:36 user nova-compute[73627]:       <target dev="tapc76ad503-8a"/>
Aug 26 16:25:36 user nova-compute[73627]:     </interface>
Aug 26 16:25:36 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:25:36 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9/console.log" append="off"/>
Aug 26 16:25:36 user nova-compute[73627]:     </serial>
Aug 26 16:25:36 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:25:36 user nova-compute[73627]:     <video>
Aug 26 16:25:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:36 user nova-compute[73627]:     </video>
Aug 26 16:25:36 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:25:36 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:25:36 user nova-compute[73627]:     </rng>
Aug 26 16:25:36 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:25:36 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:25:36 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:25:36 user nova-compute[73627]:     </memballoon>
Aug 26 16:25:36 user nova-compute[73627]:   </devices>
Aug 26 16:25:36 user nova-compute[73627]: </domain>
Aug 26 16:25:36 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "address": "fa:16:3e:5e:97:1a", "network": {"id": "b9e80f57-f3a7-4dea-baa9-0c731b953efe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1451618830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adc995e-54", "ovs_interfaceid": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "address": "fa:16:3e:5e:97:1a", "network": {"id": "b9e80f57-f3a7-4dea-baa9-0c731b953efe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1451618830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adc995e-54", "ovs_interfaceid": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:97:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adc995e-548e-4c77-9ce2-42abba1ddc8a,network=Network(b9e80f57-f3a7-4dea-baa9-0c731b953efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adc995e-54') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:97:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adc995e-548e-4c77-9ce2-42abba1ddc8a,network=Network(b9e80f57-f3a7-4dea-baa9-0c731b953efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adc995e-54') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9adc995e-54, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9adc995e-54, col_values=(('external_ids', {'iface-id': '9adc995e-548e-4c77-9ce2-42abba1ddc8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:97:1a', 'vm-uuid': '6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: INFO os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:97:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adc995e-548e-4c77-9ce2-42abba1ddc8a,network=Network(b9e80f57-f3a7-4dea-baa9-0c731b953efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adc995e-54')
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:dc:e6,bridge_name='br-int',has_traffic_filtering=True,id=8d5d4266-25e9-425f-ac4f-80fd24af6c31,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5d4266-25') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:dc:e6,bridge_name='br-int',has_traffic_filtering=True,id=8d5d4266-25e9-425f-ac4f-80fd24af6c31,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5d4266-25') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d5d4266-25, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d5d4266-25, col_values=(('external_ids', {'iface-id': '8d5d4266-25e9-425f-ac4f-80fd24af6c31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:dc:e6', 'vm-uuid': '6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: INFO os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:dc:e6,bridge_name='br-int',has_traffic_filtering=True,id=8d5d4266-25e9-425f-ac4f-80fd24af6c31,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5d4266-25')
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:06,bridge_name='br-int',has_traffic_filtering=True,id=1c1a1228-7701-4e82-872b-23fbde018c1d,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c1a1228-77') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:06,bridge_name='br-int',has_traffic_filtering=True,id=1c1a1228-7701-4e82-872b-23fbde018c1d,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c1a1228-77') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c1a1228-77, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c1a1228-77, col_values=(('external_ids', {'iface-id': '1c1a1228-7701-4e82-872b-23fbde018c1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:17:06', 'vm-uuid': '6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GrgFBvcM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:36 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:36 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:36 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: INFO os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:06,bridge_name='br-int',has_traffic_filtering=True,id=1c1a1228-7701-4e82-872b-23fbde018c1d,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c1a1228-77')
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:fb,bridge_name='br-int',has_traffic_filtering=True,id=a6b1395b-20a9-448b-97be-e353b593be0e,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b1395b-20') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:fb,bridge_name='br-int',has_traffic_filtering=True,id=a6b1395b-20a9-448b-97be-e353b593be0e,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b1395b-20') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7771d03-75a5-452e-afe1-7efcc57be915]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:25:36 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6b1395b-20, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6b1395b-20, col_values=(('external_ids', {'iface-id': 'a6b1395b-20a9-448b-97be-e353b593be0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:ff:fb', 'vm-uuid': '6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8acc4e-b506-4977-b2af-c3dbc848bc60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9] added
Aug 26 16:25:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.objects.instance [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lazy-loading 'flavor' on Instance uuid 19fcf882-d14e-4478-aed6-5e30db7d3e33 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d19ead-2d56-4b33-b371-8b8ddfd36964]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: INFO os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:fb,bridge_name='br-int',has_traffic_filtering=True,id=a6b1395b-20a9-448b-97be-e353b593be0e,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b1395b-20')
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:12:f3,bridge_name='br-int',has_traffic_filtering=True,id=c5f8ae0b-fc44-4b0f-bc7d-af523931bf04,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f8ae0b-fc') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:12:f3,bridge_name='br-int',has_traffic_filtering=True,id=c5f8ae0b-fc44-4b0f-bc7d-af523931bf04,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f8ae0b-fc') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5f8ae0b-fc, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5f8ae0b-fc, col_values=(('external_ids', {'iface-id': 'c5f8ae0b-fc44-4b0f-bc7d-af523931bf04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:12:f3', 'vm-uuid': '6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d359563a-1992-4606-af2d-aa5fc362186f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lazy-loading 'flavor' on Instance uuid 401459e7-47f6-466a-847f-01c92022bb56 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GrgFBvcM {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GrgFBvcM" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bb4802-bc0a-4609-a041-4e45e857ec36]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GrgFBvcM'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: INFO os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:12:f3,bridge_name='br-int',has_traffic_filtering=True,id=c5f8ae0b-fc44-4b0f-bc7d-af523931bf04,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f8ae0b-fc')
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=ad329dfb-604d-4430-8b10-787465b4cc8d,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad329dfb-60') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=ad329dfb-604d-4430-8b10-787465b4cc8d,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad329dfb-60') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e26419-678d-4263-9506-00d8d1fcd216]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad329dfb-60, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad329dfb-60, col_values=(('external_ids', {'iface-id': 'ad329dfb-604d-4430-8b10-787465b4cc8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:ba:71', 'vm-uuid': '6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[164b64db-9be9-4bb9-bcdd-e1b86b9416e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: INFO os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=ad329dfb-604d-4430-8b10-787465b4cc8d,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad329dfb-60')
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:7b:e0,bridge_name='br-int',has_traffic_filtering=True,id=c76ad503-8a97-4627-a8a7-46bc2f3e2055,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc76ad503-8a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7b:e0,bridge_name='br-int',has_traffic_filtering=True,id=c76ad503-8a97-4627-a8a7-46bc2f3e2055,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc76ad503-8a') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc76ad503-8a, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc76ad503-8a, col_values=(('external_ids', {'iface-id': 'c76ad503-8a97-4627-a8a7-46bc2f3e2055', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:7b:e0', 'vm-uuid': '6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5597e4e-18c4-402a-bcd8-e77e656b3811]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9, portal: 172.16.0.220,3260]
Aug 26 16:25:36 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9, portal: 172.16.0.220,3260] successful.
Aug 26 16:25:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:36 user nova-compute[73627]: INFO nova.compute.manager [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Attaching volume d5596d83-c680-4402-97c4-a49fbb258895 to /dev/vdb
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b30ecc-5307-43b9-86f7-b0535ef0e182]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:36 user nova-compute[73627]: INFO os_vif [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7b:e0,bridge_name='br-int',has_traffic_filtering=True,id=c76ad503-8a97-4627-a8a7-46bc2f3e2055,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc76ad503-8a')
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c41506-83a6-4c5a-914e-731626f71607]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.utils [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b2ea59-8e3b-413d-be78-13aa5cdf8a5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[23947b0f-edd9-4cdd-b2dd-da4610a5a6c8]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GrgFBvcM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:36 user nova-compute[73627]: INFO nova.compute.manager [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Attaching volume 43f1340c-a551-4e7c-bd3d-d376674b6340 to /dev/sdc
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bdbe9b-9d7e-4ff9-b0c3-96f183b8cc87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe6106c-e1b8-46cd-935d-aebc78807c33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ecaf0f-0662-44cd-a57f-674b60706846]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:36 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Deleted allocations for instance 09d293f0-0c31-4d11-8ba3-b6e2e4881c42
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] No BDM found with device name hda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] No VIF found with MAC fa:16:3e:5e:97:1a, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] No VIF found with MAC fa:16:3e:94:12:f3, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:25:36 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Using config drive
Aug 26 16:25:36 user nova-compute[73627]: DEBUG os_brick.utils [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:36 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3cd7f6-9482-46e6-b70e-fd092c3c4f77]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG os_brick.utils [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Updating existing volume attachment record: 0958fed0-e07c-4faf-8b94-66384a3ed28f {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2858f050-d5f9-4654-9699-dd736596cbbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8491df-2e03-4b9c-b943-78062dbc10e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a21d6a-6d63-48d5-8223-01958a53ab53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[23314c80-4ae2-48f7-b9d0-eff2af31651d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-03020580-0484-40f6-9ba3-78b29cd5ec81 tempest-DeleteServersTestJSON-1234185935 tempest-DeleteServersTestJSON-1234185935-project-member] Lock "09d293f0-0c31-4d11-8ba3-b6e2e4881c42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.196s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:37 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edfa1e1-5b71-4aa6-a0e0-a33d688fc790]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG os_brick.utils [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Updating existing volume attachment record: 6d8dc923-faac-416f-a8f2-8e37d0315b8d {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:25:37 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Creating config drive at /opt/stack/data/nova/instances/6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9/disk.config
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzw8vnvk8 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzw8vnvk8" returned: 0 in 0.065s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23763323235326661', 'path': '/dev/sdf'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763323235326661', 'path': '/dev/sdf'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'flavor' on Instance uuid eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:25:37 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:25:37 user nova-compute[73627]:   <source dev="/dev/sdf"/>
Aug 26 16:25:37 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:25:37 user nova-compute[73627]:   <serial>3387ec47-b471-4c68-a7bf-2129fa41edc9</serial>
Aug 26 16:25:37 user nova-compute[73627]: </disk>
Aug 26 16:25:37 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:25:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No VIF found with MAC fa:16:3e:67:33:ba, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:25:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-17a1dc3e-8f54-4693-850c-bbd9edf0af80 req-57ccfcca-46aa-4d17-a6f1-493e17bedb04 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-17a1dc3e-8f54-4693-850c-bbd9edf0af80 req-57ccfcca-46aa-4d17-a6f1-493e17bedb04 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-17a1dc3e-8f54-4693-850c-bbd9edf0af80 req-57ccfcca-46aa-4d17-a6f1-493e17bedb04 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-17a1dc3e-8f54-4693-850c-bbd9edf0af80 req-57ccfcca-46aa-4d17-a6f1-493e17bedb04 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-17a1dc3e-8f54-4693-850c-bbd9edf0af80 req-57ccfcca-46aa-4d17-a6f1-493e17bedb04 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:39 user nova-compute[73627]: WARNING nova.compute.manager [req-17a1dc3e-8f54-4693-850c-bbd9edf0af80 req-57ccfcca-46aa-4d17-a6f1-493e17bedb04 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a for instance with vm_state building and task_state spawning.
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-dedad9aa-5d3d-40f2-aecb-8469baae2cdb req-636ce11a-ea7e-4f1c-9737-2ac00e8da5fc service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-1c1a1228-7701-4e82-872b-23fbde018c1d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dedad9aa-5d3d-40f2-aecb-8469baae2cdb req-636ce11a-ea7e-4f1c-9737-2ac00e8da5fc service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dedad9aa-5d3d-40f2-aecb-8469baae2cdb req-636ce11a-ea7e-4f1c-9737-2ac00e8da5fc service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dedad9aa-5d3d-40f2-aecb-8469baae2cdb req-636ce11a-ea7e-4f1c-9737-2ac00e8da5fc service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-dedad9aa-5d3d-40f2-aecb-8469baae2cdb req-636ce11a-ea7e-4f1c-9737-2ac00e8da5fc service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-1c1a1228-7701-4e82-872b-23fbde018c1d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:39 user nova-compute[73627]: WARNING nova.compute.manager [req-dedad9aa-5d3d-40f2-aecb-8469baae2cdb req-636ce11a-ea7e-4f1c-9737-2ac00e8da5fc service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-1c1a1228-7701-4e82-872b-23fbde018c1d for instance with vm_state building and task_state spawning.
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-28ebc6c7-7628-407e-b572-249db539dc29 req-dcbe976b-1061-4b6e-9ec4-cbf227752811 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-28ebc6c7-7628-407e-b572-249db539dc29 req-dcbe976b-1061-4b6e-9ec4-cbf227752811 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-28ebc6c7-7628-407e-b572-249db539dc29 req-dcbe976b-1061-4b6e-9ec4-cbf227752811 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-28ebc6c7-7628-407e-b572-249db539dc29 req-dcbe976b-1061-4b6e-9ec4-cbf227752811 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-28ebc6c7-7628-407e-b572-249db539dc29 req-dcbe976b-1061-4b6e-9ec4-cbf227752811 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:40 user nova-compute[73627]: WARNING nova.compute.manager [req-28ebc6c7-7628-407e-b572-249db539dc29 req-dcbe976b-1061-4b6e-9ec4-cbf227752811 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-a6b1395b-20a9-448b-97be-e353b593be0e for instance with vm_state building and task_state spawning.
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:41 user nova-compute[73627]: WARNING nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a for instance with vm_state building and task_state spawning.
Aug 26 16:25:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:41 user nova-compute[73627]: WARNING nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 for instance with vm_state building and task_state spawning.
Aug 26 16:25:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:41 user nova-compute[73627]: WARNING nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 for instance with vm_state building and task_state spawning.
Aug 26 16:25:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:41 user nova-compute[73627]: WARNING nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 for instance with vm_state building and task_state spawning.
Aug 26 16:25:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:41 user nova-compute[73627]: WARNING nova.compute.manager [req-895a32f0-52a1-4a22-9d37-60149a04e657 req-ed1ca5d9-966e-40eb-b6d6-c8c3072daf99 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 for instance with vm_state building and task_state spawning.
Aug 26 16:25:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-93910933-4244-4593-a190-4a782aff5711 req-d3bdeeaa-b7df-4a8a-8f7d-72d8f345aeb8 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-1c1a1228-7701-4e82-872b-23fbde018c1d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-93910933-4244-4593-a190-4a782aff5711 req-d3bdeeaa-b7df-4a8a-8f7d-72d8f345aeb8 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-93910933-4244-4593-a190-4a782aff5711 req-d3bdeeaa-b7df-4a8a-8f7d-72d8f345aeb8 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-93910933-4244-4593-a190-4a782aff5711 req-d3bdeeaa-b7df-4a8a-8f7d-72d8f345aeb8 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-93910933-4244-4593-a190-4a782aff5711 req-d3bdeeaa-b7df-4a8a-8f7d-72d8f345aeb8 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-1c1a1228-7701-4e82-872b-23fbde018c1d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:42 user nova-compute[73627]: WARNING nova.compute.manager [req-93910933-4244-4593-a190-4a782aff5711 req-d3bdeeaa-b7df-4a8a-8f7d-72d8f345aeb8 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-1c1a1228-7701-4e82-872b-23fbde018c1d for instance with vm_state building and task_state spawning.
Aug 26 16:25:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:42 user nova-compute[73627]: WARNING nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-a6b1395b-20a9-448b-97be-e353b593be0e for instance with vm_state building and task_state spawning.
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:42 user nova-compute[73627]: WARNING nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-ad329dfb-604d-4430-8b10-787465b4cc8d for instance with vm_state building and task_state spawning.
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:42 user nova-compute[73627]: WARNING nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-ad329dfb-604d-4430-8b10-787465b4cc8d for instance with vm_state building and task_state spawning.
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:42 user nova-compute[73627]: WARNING nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 for instance with vm_state building and task_state spawning.
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:42 user nova-compute[73627]: WARNING nova.compute.manager [req-c98838b2-b702-4142-a2f4-7d41e9618cc1 req-e9586b36-66ce-456d-bc1e-5edfd938b69d service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 for instance with vm_state building and task_state spawning.
Aug 26 16:25:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067143.1110208, 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:25:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] VM Resumed (Lifecycle Event)
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:25:43 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Instance spawned successfully.
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067143.1130311, 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:25:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] VM Started (Lifecycle Event)
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:25:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:25:43 user nova-compute[73627]: INFO nova.compute.manager [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Took 11.16 seconds to spawn the instance on the hypervisor.
Aug 26 16:25:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:25:43 user nova-compute[73627]: INFO nova.compute.manager [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Took 53.62 seconds to build instance.
Aug 26 16:25:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0dec493-a2a2-4269-acad-f0d48a4a8242 tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.717s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e4379ff2-888d-402d-85e4-71fa7cba2f92 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.809s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-8d8e9eed-c509-4a29-94f9-9d696b5c693c req-65459851-f917-4849-bd5b-ee04c28ba2e5 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-changed-a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-8d8e9eed-c509-4a29-94f9-9d696b5c693c req-65459851-f917-4849-bd5b-ee04c28ba2e5 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Refreshing instance network info cache due to event network-changed-a75b9117-9045-4d5f-8b40-028c8f498bb9. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8d8e9eed-c509-4a29-94f9-9d696b5c693c req-65459851-f917-4849-bd5b-ee04c28ba2e5 service nova] Acquiring lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8d8e9eed-c509-4a29-94f9-9d696b5c693c req-65459851-f917-4849-bd5b-ee04c28ba2e5 service nova] Acquired lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.network.neutron [req-8d8e9eed-c509-4a29-94f9-9d696b5c693c req-65459851-f917-4849-bd5b-ee04c28ba2e5 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Refreshing network info cache for port a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:25:45 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Creating image(s)
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Ensure instance console log exists: /opt/stack/data/nova/instances/f961b797-16bd-43bd-8735-93578f1084cf/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Start _get_guest_xml network_info=[{"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmOjtqBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f961b797-16bd-43bd-8735-93578f1084cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9b2c748-f107-4a1d-87a3-dbbe8f232242', 'serial': 'e9b2c748-f107-4a1d-87a3-dbbe8f232242'}, 'guest_format': None, 'attachment_id': '454a3362-cb61-41c1-a21a-833e037212d7', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVXgtGyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f961b797-16bd-43bd-8735-93578f1084cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4d03986-90cc-44b3-a12a-345b32664c19', 'serial': 'f4d03986-90cc-44b3-a12a-345b32664c19'}, 'guest_format': None, 'attachment_id': '2ae4c936-8b1f-45d9-a5aa-5ee770e1dfd5', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARJdboHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f961b797-16bd-43bd-8735-93578f1084cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7c23dce-9a2f-4659-a509-c67bcf9060f5', 'serial': 'd7c23dce-9a2f-4659-a509-c67bcf9060f5'}, 'guest_format': None, 'attachment_id': '2d5fa06d-4600-430d-a40e-84e5ae9907b5', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:25:45 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:25:45 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmOjtqBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:45 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:45 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:45 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[be15bae0-dda2-4dd0-968a-978392220300]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:25:45 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60455e0-bc64-424b-9cd8-1151deab5d4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242] added
Aug 26 16:25:45 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d054f316-853b-475c-ad55-fe4e5b08123f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1a573c-5135-49aa-bab5-15108eeeed34]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmOjtqBI {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmOjtqBI" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f28c0f-13af-44e8-8780-5ca964dc9023]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SmOjtqBI'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe12015-2ccc-41ef-a0cb-daa6b92aa272]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa2be8d-7eeb-4595-a0a5-1790186ca901]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fa09fb-0003-4236-9c6d-3734ecaa7bb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242, portal: 172.16.0.220,3260]
Aug 26 16:25:46 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242, portal: 172.16.0.220,3260] successful.
Aug 26 16:25:46 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e311742a-0d43-48e4-a55d-b63281196909]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12ce5d0-4e80-42b1-8e83-35d34e376e8c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:25:46 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53835a9-b5a0-47fc-8011-e07bc5899ef4]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmOjtqBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG nova.network.neutron [req-8d8e9eed-c509-4a29-94f9-9d696b5c693c req-65459851-f917-4849-bd5b-ee04c28ba2e5 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Updated VIF entry in instance network info cache for port a75b9117-9045-4d5f-8b40-028c8f498bb9. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG nova.network.neutron [req-8d8e9eed-c509-4a29-94f9-9d696b5c693c req-65459851-f917-4849-bd5b-ee04c28ba2e5 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Updating instance_info_cache with network_info: [{"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8d8e9eed-c509-4a29-94f9-9d696b5c693c req-65459851-f917-4849-bd5b-ee04c28ba2e5 service nova] Releasing lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "interface-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "interface-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:46 user nova-compute[73627]: DEBUG nova.objects.instance [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lazy-loading 'flavor' on Instance uuid 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG nova.objects.instance [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lazy-loading 'pci_requests' on Instance uuid 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG nova.objects.base [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Object Instance<7329f0f0-e851-4a58-92b6-4edc3f9ec5e8> lazy-loaded attributes: flavor,pci_requests {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG nova.network.neutron [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23939326539356630', 'path': '/dev/sdg'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939326539356630', 'path': '/dev/sdg'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVXgtGyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:47 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:47 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:47 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[611b889f-557f-4358-9d29-50a88f59f24b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:25:47 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG nova.policy [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd553291cb27f449bb89c46add55e67e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b9b0bdf908482ea1645968ddc1ba73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6466d44-dcaa-40ca-a66f-7225be0d93db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19] added
Aug 26 16:25:47 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2b0a2e-ddef-44e5-98a3-4e21187926b3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-ba676e64-c9d9-4cb1-b158-7f6947c6bdbc req-bd31c64e-7f31-4ac1-9cb1-ce3babbfb427 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Received event network-changed-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-ba676e64-c9d9-4cb1-b158-7f6947c6bdbc req-bd31c64e-7f31-4ac1-9cb1-ce3babbfb427 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Refreshing instance network info cache due to event network-changed-7c01107b-5db8-4c30-b7eb-179c1cfdadc1. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ba676e64-c9d9-4cb1-b158-7f6947c6bdbc req-bd31c64e-7f31-4ac1-9cb1-ce3babbfb427 service nova] Acquiring lock "refresh_cache-3b4253a4-1436-4026-8549-f48f1bb8f121" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ba676e64-c9d9-4cb1-b158-7f6947c6bdbc req-bd31c64e-7f31-4ac1-9cb1-ce3babbfb427 service nova] Acquired lock "refresh_cache-3b4253a4-1436-4026-8549-f48f1bb8f121" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG nova.network.neutron [req-ba676e64-c9d9-4cb1-b158-7f6947c6bdbc req-bd31c64e-7f31-4ac1-9cb1-ce3babbfb427 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Refreshing network info cache for port 7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[29229956-0927-4db0-b45d-960ca14d40d8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DVXgtGyW {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DVXgtGyW" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5d5f82-6a3b-4628-b21d-4d74f35c145a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DVXgtGyW'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f738b6-ed64-4983-b8da-b06f77df0406]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c69ef62-1dc4-4590-a0da-3812df83218d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[da650a39-b189-42f6-97db-eda92fef80a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19, portal: 172.16.0.220,3260]
Aug 26 16:25:47 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19, portal: 172.16.0.220,3260] successful.
Aug 26 16:25:47 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b8edaa-f637-4686-8a89-5242510d791e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2020145c-122e-4cc5-9b4d-5ec664abcdb3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:25:47 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Acquiring lock "3b4253a4-1436-4026-8549-f48f1bb8f121" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1684b7-7a40-486b-9896-5ef437cffb65]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVXgtGyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG nova.objects.instance [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lazy-loading 'flavor' on Instance uuid 3b4253a4-1436-4026-8549-f48f1bb8f121 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG nova.network.neutron [req-ba676e64-c9d9-4cb1-b158-7f6947c6bdbc req-bd31c64e-7f31-4ac1-9cb1-ce3babbfb427 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Updated VIF entry in instance network info cache for port 7c01107b-5db8-4c30-b7eb-179c1cfdadc1. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG nova.network.neutron [req-ba676e64-c9d9-4cb1-b158-7f6947c6bdbc req-bd31c64e-7f31-4ac1-9cb1-ce3babbfb427 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Updating instance_info_cache with network_info: [{"id": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "address": "fa:16:3e:7c:c9:53", "network": {"id": "c283b31b-dc07-4174-8354-d08d62d93df9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-305034803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ed90cd886d40f5bf932825592a5be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c01107b-5d", "ovs_interfaceid": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Acquiring lock "3b4253a4-1436-4026-8549-f48f1bb8f121" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:48 user nova-compute[73627]: INFO nova.compute.manager [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Attaching volume 9a5a6f06-ede0-48aa-9c48-87cf782f8515 to /dev/vdb
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ba676e64-c9d9-4cb1-b158-7f6947c6bdbc req-bd31c64e-7f31-4ac1-9cb1-ce3babbfb427 service nova] Releasing lock "refresh_cache-3b4253a4-1436-4026-8549-f48f1bb8f121" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.utils [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[227d7029-3697-4353-a1d9-9357e33bd11f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG nova.network.neutron [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Successfully created port: efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6b436-4d53-40e8-b1d2-832c9ad7f653]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d64b72-fa8b-46e0-8fad-c4a05ec3e8eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dbd128-af59-4205-a357-9caa20760b8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:25:48 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a16659c-17c4-4f0e-80b3-81c361e0e37a]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.utils [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Updating existing volume attachment record: c4f92d4c-408a-41e8-b4e1-9aecaae4d680 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '26563343033363832', 'path': '/dev/sdh'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563343033363832', 'path': '/dev/sdh'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARJdboHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:25:48 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:48 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:25:48 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb5fa18-e75f-48e3-b2fe-1ce73f2e444c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:25:48 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef64375-f5d5-4481-a5e5-060218a4532b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5] added
Aug 26 16:25:48 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9023747e-1120-4ebe-87e0-55e2b30c7731]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3720b45c-263c-4312-8073-a02ff5d706af]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARJdboHj {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARJdboHj" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9e298b-56b6-447a-bc6b-4b4f61da7187]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ARJdboHj'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e38fe9-257b-48b9-8916-d6cbded5e0cd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeb9f32-3f06-489e-91fe-02dff2507156]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[684b623f-7c96-4144-aa35-4e28b8d34afd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5, portal: 172.16.0.220,3260]
Aug 26 16:25:49 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5, portal: 172.16.0.220,3260] successful.
Aug 26 16:25:49 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[030a754d-dbee-4d8a-aaaf-51f267a9017c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG nova.network.neutron [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Successfully updated port: efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquired lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG nova.network.neutron [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fabea22-3711-4b66-8623-2cb1056eb9ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:25:49 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-56e84570-8392-4e2b-8167-cfe15828021e req-2de16cfa-5288-42a6-ada8-e9a4f5614555 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-changed-efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-56e84570-8392-4e2b-8167-cfe15828021e req-2de16cfa-5288-42a6-ada8-e9a4f5614555 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Refreshing instance network info cache due to event network-changed-efb9a29e-9e9c-4c16-8e3f-20adbb774778. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-56e84570-8392-4e2b-8167-cfe15828021e req-2de16cfa-5288-42a6-ada8-e9a4f5614555 service nova] Acquiring lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[337329c6-778e-4566-af9a-6626a934c99a]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARJdboHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:25:49 user nova-compute[73627]: INFO nova.compute.claims [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Claim successful on node user
Aug 26 16:25:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.neutron [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Updating instance_info_cache with network_info: [{"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "address": "fa:16:3e:15:dc:0f", "network": {"id": "6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-808001052", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9a29e-9e", "ovs_interfaceid": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Releasing lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-56e84570-8392-4e2b-8167-cfe15828021e req-2de16cfa-5288-42a6-ada8-e9a4f5614555 service nova] Acquired lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.neutron [req-56e84570-8392-4e2b-8167-cfe15828021e req-2de16cfa-5288-42a6-ada8-e9a4f5614555 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Refreshing network info cache for port efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463194229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463194229',id=8,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Sj6yy35YwIDlvvvihzQymqFhoon7RMyC7OSNPYjzgUeKCKw+OuVT0CMoXlNszZUBa6Mj8sVK/09WRxOxBs8UryT21dkwjmnJCwl3Lu9BmupDqwjouXifLfMdb3Sz8bg==',key_name='tempest-keypair-339813193',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5b9b0bdf908482ea1645968ddc1ba73',ramdisk_id='',reservation_id='r-cb6v5hvu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130913096',owner_user_name='tempest-TaggedAttachmentsTest-1130913096-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:24:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d553291cb27f449bb89c46add55e67e3',uuid=7329f0f0-e851-4a58-92b6-4edc3f9ec5e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "address": "fa:16:3e:15:dc:0f", "network": {"id": "6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-808001052", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9a29e-9e", "ovs_interfaceid": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converting VIF {"id": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "address": "fa:16:3e:15:dc:0f", "network": {"id": "6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-808001052", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9a29e-9e", "ovs_interfaceid": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:0f,bridge_name='br-int',has_traffic_filtering=True,id=efb9a29e-9e9c-4c16-8e3f-20adbb774778,network=Network(6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9a29e-9e') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG os_vif [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:0f,bridge_name='br-int',has_traffic_filtering=True,id=efb9a29e-9e9c-4c16-8e3f-20adbb774778,network=Network(6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9a29e-9e') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefb9a29e-9e, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapefb9a29e-9e, col_values=(('external_ids', {'iface-id': 'efb9a29e-9e9c-4c16-8e3f-20adbb774778', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:dc:0f', 'vm-uuid': '7329f0f0-e851-4a58-92b6-4edc3f9ec5e8'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: INFO os_vif [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:0f,bridge_name='br-int',has_traffic_filtering=True,id=efb9a29e-9e9c-4c16-8e3f-20adbb774778,network=Network(6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9a29e-9e')
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463194229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463194229',id=8,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Sj6yy35YwIDlvvvihzQymqFhoon7RMyC7OSNPYjzgUeKCKw+OuVT0CMoXlNszZUBa6Mj8sVK/09WRxOxBs8UryT21dkwjmnJCwl3Lu9BmupDqwjouXifLfMdb3Sz8bg==',key_name='tempest-keypair-339813193',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5b9b0bdf908482ea1645968ddc1ba73',ramdisk_id='',reservation_id='r-cb6v5hvu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130913096',owner_user_name='tempest-TaggedAttachmentsTest-1130913096-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:24:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d553291cb27f449bb89c46add55e67e3',uuid=7329f0f0-e851-4a58-92b6-4edc3f9ec5e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "address": "fa:16:3e:15:dc:0f", "network": {"id": "6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-808001052", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9a29e-9e", "ovs_interfaceid": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converting VIF {"id": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "address": "fa:16:3e:15:dc:0f", "network": {"id": "6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-808001052", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9a29e-9e", "ovs_interfaceid": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:0f,bridge_name='br-int',has_traffic_filtering=True,id=efb9a29e-9e9c-4c16-8e3f-20adbb774778,network=Network(6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9a29e-9e') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] attach device xml: <interface type="ethernet">
Aug 26 16:25:50 user nova-compute[73627]:   <mac address="fa:16:3e:15:dc:0f"/>
Aug 26 16:25:50 user nova-compute[73627]:   <model type="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:   <mtu size="1442"/>
Aug 26 16:25:50 user nova-compute[73627]:   <target dev="tapefb9a29e-9e"/>
Aug 26 16:25:50 user nova-compute[73627]: </interface>
Aug 26 16:25:50 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.492s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] <== connect_volume: return (1498ms) {'type': 'block', 'scsi_wwn': '23131366464353539', 'path': '/dev/sdi'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131366464353539', 'path': '/dev/sdi'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.655s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0a:94,bridge_name='br-int',has_traffic_filtering=True,id=d01767e2-a65b-4bbd-ae31-97eccf191447,network=Network(eafd9e23-3342-4d6b-a908-2973064b8b31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01767e2-a6') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b5:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0e633e2-4663-405f-a0f4-b9dc5b3712a9,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0e633e2-46') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ff6530f-236c-4e59-b361-36cbc188b9f7,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff6530f-23') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=fb075d9c-38a0-4fe7-a3ad-3ccd4db43646,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb075d9c-38') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:08:db,bridge_name='br-int',has_traffic_filtering=True,id=89f0db97-51c1-44f3-8009-1624dfa94db4,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0db97-51') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:46:d7,bridge_name='br-int',has_traffic_filtering=True,id=0417fa30-6f31-4ecb-a6e4-a25accad0428,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0417fa30-6f') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:26,bridge_name='br-int',has_traffic_filtering=True,id=60158f05-7509-4976-85e8-fdeff3b26a24,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60158f05-75') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lazy-loading 'pci_devices' on Instance uuid f961b797-16bd-43bd-8735-93578f1084cf {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:25:50 user nova-compute[73627]:   <uuid>f961b797-16bd-43bd-8735-93578f1084cf</uuid>
Aug 26 16:25:50 user nova-compute[73627]:   <name>instance-0000000d</name>
Aug 26 16:25:50 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:25:50 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:25:50 user nova-compute[73627]:   <metadata>
Aug 26 16:25:50 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:25:50 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:25:50 user nova-compute[73627]:       <nova:name>tempest-device-tagging-server-2111092014</nova:name>
Aug 26 16:25:50 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:25:45</nova:creationTime>
Aug 26 16:25:50 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:25:50 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:25:50 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:25:50 user nova-compute[73627]:       <nova:owner>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:user uuid="53847c7a2cea42f8ae4aeecea2053ca7">tempest-TaggedBootDevicesTest-2086654860-project-member</nova:user>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:project uuid="2462ff948ebb487d92ac3a3e2b281102">tempest-TaggedBootDevicesTest-2086654860</nova:project>
Aug 26 16:25:50 user nova-compute[73627]:       </nova:owner>
Aug 26 16:25:50 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:25:50 user nova-compute[73627]:       <nova:ports>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:port uuid="d01767e2-a65b-4bbd-ae31-97eccf191447">
Aug 26 16:25:50 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 16:25:50 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:port uuid="e0e633e2-4663-405f-a0f4-b9dc5b3712a9">
Aug 26 16:25:50 user nova-compute[73627]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
Aug 26 16:25:50 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:port uuid="7ff6530f-236c-4e59-b361-36cbc188b9f7">
Aug 26 16:25:50 user nova-compute[73627]:           <nova:ip type="fixed" address="10.1.1.132" ipVersion="4"/>
Aug 26 16:25:50 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:port uuid="fb075d9c-38a0-4fe7-a3ad-3ccd4db43646">
Aug 26 16:25:50 user nova-compute[73627]:           <nova:ip type="fixed" address="10.1.1.74" ipVersion="4"/>
Aug 26 16:25:50 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:port uuid="89f0db97-51c1-44f3-8009-1624dfa94db4">
Aug 26 16:25:50 user nova-compute[73627]:           <nova:ip type="fixed" address="10.1.1.56" ipVersion="4"/>
Aug 26 16:25:50 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:port uuid="0417fa30-6f31-4ecb-a6e4-a25accad0428">
Aug 26 16:25:50 user nova-compute[73627]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 16:25:50 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:50 user nova-compute[73627]:         <nova:port uuid="60158f05-7509-4976-85e8-fdeff3b26a24">
Aug 26 16:25:50 user nova-compute[73627]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 16:25:50 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:50 user nova-compute[73627]:       </nova:ports>
Aug 26 16:25:50 user nova-compute[73627]:     </nova:instance>
Aug 26 16:25:50 user nova-compute[73627]:   </metadata>
Aug 26 16:25:50 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:25:50 user nova-compute[73627]:     <system>
Aug 26 16:25:50 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:25:50 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:25:50 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:25:50 user nova-compute[73627]:       <entry name="serial">f961b797-16bd-43bd-8735-93578f1084cf</entry>
Aug 26 16:25:50 user nova-compute[73627]:       <entry name="uuid">f961b797-16bd-43bd-8735-93578f1084cf</entry>
Aug 26 16:25:50 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:25:50 user nova-compute[73627]:     </system>
Aug 26 16:25:50 user nova-compute[73627]:   </sysinfo>
Aug 26 16:25:50 user nova-compute[73627]:   <os>
Aug 26 16:25:50 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:25:50 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:25:50 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:25:50 user nova-compute[73627]:   </os>
Aug 26 16:25:50 user nova-compute[73627]:   <features>
Aug 26 16:25:50 user nova-compute[73627]:     <acpi/>
Aug 26 16:25:50 user nova-compute[73627]:     <apic/>
Aug 26 16:25:50 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:25:50 user nova-compute[73627]:   </features>
Aug 26 16:25:50 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:25:50 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:25:50 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:25:50 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:25:50 user nova-compute[73627]:   </clock>
Aug 26 16:25:50 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:25:50 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:25:50 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:25:50 user nova-compute[73627]:   </cpu>
Aug 26 16:25:50 user nova-compute[73627]:   <devices>
Aug 26 16:25:50 user nova-compute[73627]:     <disk type="file" device="cdrom">
Aug 26 16:25:50 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 16:25:50 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/f961b797-16bd-43bd-8735-93578f1084cf/disk.config"/>
Aug 26 16:25:50 user nova-compute[73627]:       <target dev="hda" bus="ide"/>
Aug 26 16:25:50 user nova-compute[73627]:     </disk>
Aug 26 16:25:50 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:25:50 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:25:50 user nova-compute[73627]:       <source dev="/dev/sdg"/>
Aug 26 16:25:50 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:       <serial>e9b2c748-f107-4a1d-87a3-dbbe8f232242</serial>
Aug 26 16:25:50 user nova-compute[73627]:     </disk>
Aug 26 16:25:50 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:25:50 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:25:50 user nova-compute[73627]:       <source dev="/dev/sdh"/>
Aug 26 16:25:50 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:       <serial>f4d03986-90cc-44b3-a12a-345b32664c19</serial>
Aug 26 16:25:50 user nova-compute[73627]:     </disk>
Aug 26 16:25:50 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:25:50 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:25:50 user nova-compute[73627]:       <source dev="/dev/sdi"/>
Aug 26 16:25:50 user nova-compute[73627]:       <target dev="vdc" bus="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:       <serial>d7c23dce-9a2f-4659-a509-c67bcf9060f5</serial>
Aug 26 16:25:50 user nova-compute[73627]:     </disk>
Aug 26 16:25:50 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:50 user nova-compute[73627]:       <mac address="fa:16:3e:5a:0a:94"/>
Aug 26 16:25:50 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:50 user nova-compute[73627]:       <target dev="tapd01767e2-a6"/>
Aug 26 16:25:50 user nova-compute[73627]:     </interface>
Aug 26 16:25:50 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:50 user nova-compute[73627]:       <mac address="fa:16:3e:e7:b5:ef"/>
Aug 26 16:25:50 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:50 user nova-compute[73627]:       <target dev="tape0e633e2-46"/>
Aug 26 16:25:50 user nova-compute[73627]:     </interface>
Aug 26 16:25:50 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:50 user nova-compute[73627]:       <mac address="fa:16:3e:ab:7c:5f"/>
Aug 26 16:25:50 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:50 user nova-compute[73627]:       <target dev="tap7ff6530f-23"/>
Aug 26 16:25:50 user nova-compute[73627]:     </interface>
Aug 26 16:25:50 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:50 user nova-compute[73627]:       <mac address="fa:16:3e:99:e9:f8"/>
Aug 26 16:25:50 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:50 user nova-compute[73627]:       <target dev="tapfb075d9c-38"/>
Aug 26 16:25:50 user nova-compute[73627]:     </interface>
Aug 26 16:25:50 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:50 user nova-compute[73627]:       <mac address="fa:16:3e:3f:08:db"/>
Aug 26 16:25:50 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:50 user nova-compute[73627]:       <target dev="tap89f0db97-51"/>
Aug 26 16:25:50 user nova-compute[73627]:     </interface>
Aug 26 16:25:50 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:50 user nova-compute[73627]:       <mac address="fa:16:3e:60:46:d7"/>
Aug 26 16:25:50 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:50 user nova-compute[73627]:       <target dev="tap0417fa30-6f"/>
Aug 26 16:25:50 user nova-compute[73627]:     </interface>
Aug 26 16:25:50 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:50 user nova-compute[73627]:       <mac address="fa:16:3e:b2:3c:26"/>
Aug 26 16:25:50 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:50 user nova-compute[73627]:       <target dev="tap60158f05-75"/>
Aug 26 16:25:50 user nova-compute[73627]:     </interface>
Aug 26 16:25:50 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:25:50 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/f961b797-16bd-43bd-8735-93578f1084cf/console.log" append="off"/>
Aug 26 16:25:50 user nova-compute[73627]:     </serial>
Aug 26 16:25:50 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:25:50 user nova-compute[73627]:     <video>
Aug 26 16:25:50 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:50 user nova-compute[73627]:     </video>
Aug 26 16:25:50 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:25:50 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:25:50 user nova-compute[73627]:     </rng>
Aug 26 16:25:50 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:25:50 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:25:50 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:25:50 user nova-compute[73627]:     </memballoon>
Aug 26 16:25:50 user nova-compute[73627]:   </devices>
Aug 26 16:25:50 user nova-compute[73627]: </domain>
Aug 26 16:25:50 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0a:94,bridge_name='br-int',has_traffic_filtering=True,id=d01767e2-a65b-4bbd-ae31-97eccf191447,network=Network(eafd9e23-3342-4d6b-a908-2973064b8b31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01767e2-a6') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0a:94,bridge_name='br-int',has_traffic_filtering=True,id=d01767e2-a65b-4bbd-ae31-97eccf191447,network=Network(eafd9e23-3342-4d6b-a908-2973064b8b31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01767e2-a6') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd01767e2-a6, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd01767e2-a6, col_values=(('external_ids', {'iface-id': 'd01767e2-a65b-4bbd-ae31-97eccf191447', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:0a:94', 'vm-uuid': 'f961b797-16bd-43bd-8735-93578f1084cf'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:50 user nova-compute[73627]: INFO os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0a:94,bridge_name='br-int',has_traffic_filtering=True,id=d01767e2-a65b-4bbd-ae31-97eccf191447,network=Network(eafd9e23-3342-4d6b-a908-2973064b8b31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01767e2-a6')
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b5:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0e633e2-4663-405f-a0f4-b9dc5b3712a9,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0e633e2-46') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b5:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0e633e2-4663-405f-a0f4-b9dc5b3712a9,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0e633e2-46') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0e633e2-46, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0e633e2-46, col_values=(('external_ids', {'iface-id': 'e0e633e2-4663-405f-a0f4-b9dc5b3712a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:b5:ef', 'vm-uuid': 'f961b797-16bd-43bd-8735-93578f1084cf'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: INFO os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b5:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0e633e2-4663-405f-a0f4-b9dc5b3712a9,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0e633e2-46')
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ff6530f-236c-4e59-b361-36cbc188b9f7,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff6530f-23') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ff6530f-236c-4e59-b361-36cbc188b9f7,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff6530f-23') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ff6530f-23, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ff6530f-23, col_values=(('external_ids', {'iface-id': '7ff6530f-236c-4e59-b361-36cbc188b9f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:7c:5f', 'vm-uuid': 'f961b797-16bd-43bd-8735-93578f1084cf'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: INFO os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ff6530f-236c-4e59-b361-36cbc188b9f7,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff6530f-23')
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=fb075d9c-38a0-4fe7-a3ad-3ccd4db43646,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb075d9c-38') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=fb075d9c-38a0-4fe7-a3ad-3ccd4db43646,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb075d9c-38') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb075d9c-38, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb075d9c-38, col_values=(('external_ids', {'iface-id': 'fb075d9c-38a0-4fe7-a3ad-3ccd4db43646', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:e9:f8', 'vm-uuid': 'f961b797-16bd-43bd-8735-93578f1084cf'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:25:50 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Creating image(s)
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "/opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "/opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: INFO os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=fb075d9c-38a0-4fe7-a3ad-3ccd4db43646,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb075d9c-38')
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:08:db,bridge_name='br-int',has_traffic_filtering=True,id=89f0db97-51c1-44f3-8009-1624dfa94db4,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0db97-51') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:08:db,bridge_name='br-int',has_traffic_filtering=True,id=89f0db97-51c1-44f3-8009-1624dfa94db4,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0db97-51') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.policy [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd643e68350c749df9a033c5ee9bae19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78924631c2e241b0b0c5cb8c9c24b4a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-b421c768-951a-493d-b07a-59b1ba395a81 req-569e15c4-1b06-4687-bccb-0a80309ddbca service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-vif-plugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b421c768-951a-493d-b07a-59b1ba395a81 req-569e15c4-1b06-4687-bccb-0a80309ddbca service nova] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b421c768-951a-493d-b07a-59b1ba395a81 req-569e15c4-1b06-4687-bccb-0a80309ddbca service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b421c768-951a-493d-b07a-59b1ba395a81 req-569e15c4-1b06-4687-bccb-0a80309ddbca service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-b421c768-951a-493d-b07a-59b1ba395a81 req-569e15c4-1b06-4687-bccb-0a80309ddbca service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] No waiting events found dispatching network-vif-plugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:50 user nova-compute[73627]: WARNING nova.compute.manager [req-b421c768-951a-493d-b07a-59b1ba395a81 req-569e15c4-1b06-4687-bccb-0a80309ddbca service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received unexpected event network-vif-plugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 for instance with vm_state active and task_state None.
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89f0db97-51, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89f0db97-51, col_values=(('external_ids', {'iface-id': '89f0db97-51c1-44f3-8009-1624dfa94db4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:08:db', 'vm-uuid': 'f961b797-16bd-43bd-8735-93578f1084cf'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] No BDM found with device name hda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] No VIF found with MAC fa:16:3e:2f:bb:ce, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: INFO os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:08:db,bridge_name='br-int',has_traffic_filtering=True,id=89f0db97-51c1-44f3-8009-1624dfa94db4,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0db97-51')
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:46:d7,bridge_name='br-int',has_traffic_filtering=True,id=0417fa30-6f31-4ecb-a6e4-a25accad0428,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0417fa30-6f') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:46:d7,bridge_name='br-int',has_traffic_filtering=True,id=0417fa30-6f31-4ecb-a6e4-a25accad0428,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0417fa30-6f') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:25:50 user nova-compute[73627]:   <nova:package version="0.0.0"/>
Aug 26 16:25:50 user nova-compute[73627]:   <nova:name>tempest-device-tagging-server-1463194229</nova:name>
Aug 26 16:25:50 user nova-compute[73627]:   <nova:creationTime>2023-08-26 16:25:50</nova:creationTime>
Aug 26 16:25:50 user nova-compute[73627]:   <nova:flavor name="m1.tiny">
Aug 26 16:25:50 user nova-compute[73627]:     <nova:memory>512</nova:memory>
Aug 26 16:25:50 user nova-compute[73627]:     <nova:disk>1</nova:disk>
Aug 26 16:25:50 user nova-compute[73627]:     <nova:swap>0</nova:swap>
Aug 26 16:25:50 user nova-compute[73627]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:25:50 user nova-compute[73627]:     <nova:vcpus>1</nova:vcpus>
Aug 26 16:25:50 user nova-compute[73627]:   </nova:flavor>
Aug 26 16:25:50 user nova-compute[73627]:   <nova:owner>
Aug 26 16:25:50 user nova-compute[73627]:     <nova:user uuid="d553291cb27f449bb89c46add55e67e3">tempest-TaggedAttachmentsTest-1130913096-project-member</nova:user>
Aug 26 16:25:50 user nova-compute[73627]:     <nova:project uuid="f5b9b0bdf908482ea1645968ddc1ba73">tempest-TaggedAttachmentsTest-1130913096</nova:project>
Aug 26 16:25:50 user nova-compute[73627]:   </nova:owner>
Aug 26 16:25:50 user nova-compute[73627]:   <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:25:50 user nova-compute[73627]:   <nova:ports>
Aug 26 16:25:50 user nova-compute[73627]:     <nova:port uuid="a75b9117-9045-4d5f-8b40-028c8f498bb9">
Aug 26 16:25:50 user nova-compute[73627]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 16:25:50 user nova-compute[73627]:     </nova:port>
Aug 26 16:25:50 user nova-compute[73627]:     <nova:port uuid="efb9a29e-9e9c-4c16-8e3f-20adbb774778">
Aug 26 16:25:50 user nova-compute[73627]:       <nova:ip type="fixed" address="10.10.10.169" ipVersion="4"/>
Aug 26 16:25:50 user nova-compute[73627]:     </nova:port>
Aug 26 16:25:50 user nova-compute[73627]:   </nova:ports>
Aug 26 16:25:50 user nova-compute[73627]: </nova:instance>
Aug 26 16:25:50 user nova-compute[73627]:  {{(pid=73627) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0417fa30-6f, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0417fa30-6f, col_values=(('external_ids', {'iface-id': '0417fa30-6f31-4ecb-a6e4-a25accad0428', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:46:d7', 'vm-uuid': 'f961b797-16bd-43bd-8735-93578f1084cf'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.neutron [req-56e84570-8392-4e2b-8167-cfe15828021e req-2de16cfa-5288-42a6-ada8-e9a4f5614555 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Updated VIF entry in instance network info cache for port efb9a29e-9e9c-4c16-8e3f-20adbb774778. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG nova.network.neutron [req-56e84570-8392-4e2b-8167-cfe15828021e req-2de16cfa-5288-42a6-ada8-e9a4f5614555 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Updating instance_info_cache with network_info: [{"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "address": "fa:16:3e:15:dc:0f", "network": {"id": "6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-808001052", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9a29e-9e", "ovs_interfaceid": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.272s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-92a41cee-308c-4366-bece-46b4949ba52d tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "interface-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.180s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-56e84570-8392-4e2b-8167-cfe15828021e req-2de16cfa-5288-42a6-ada8-e9a4f5614555 service nova] Releasing lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:51 user nova-compute[73627]: INFO os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:46:d7,bridge_name='br-int',has_traffic_filtering=True,id=0417fa30-6f31-4ecb-a6e4-a25accad0428,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0417fa30-6f')
Aug 26 16:25:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:26,bridge_name='br-int',has_traffic_filtering=True,id=60158f05-7509-4976-85e8-fdeff3b26a24,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60158f05-75') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:26,bridge_name='br-int',has_traffic_filtering=True,id=60158f05-7509-4976-85e8-fdeff3b26a24,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60158f05-75') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60158f05-75, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60158f05-75, col_values=(('external_ids', {'iface-id': '60158f05-7509-4976-85e8-fdeff3b26a24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:3c:26', 'vm-uuid': 'f961b797-16bd-43bd-8735-93578f1084cf'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.208s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk 1073741824" returned: 0 in 0.052s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:51 user nova-compute[73627]: INFO os_vif [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:26,bridge_name='br-int',has_traffic_filtering=True,id=60158f05-7509-4976-85e8-fdeff3b26a24,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60158f05-75')
Aug 26 16:25:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] No BDM found with device name hda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] No VIF found with MAC fa:16:3e:5a:0a:94, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] No VIF found with MAC fa:16:3e:3f:08:db, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:25:51 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Using config drive
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:51 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Creating config drive at /opt/stack/data/nova/instances/f961b797-16bd-43bd-8735-93578f1084cf/disk.config
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f961b797-16bd-43bd-8735-93578f1084cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0qfkn66j {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f961b797-16bd-43bd-8735-93578f1084cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0qfkn66j" returned: 0 in 0.057s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Cannot resize image /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Ensure instance console log exists: /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:52 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Successfully created port: a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:25:52 user nova-compute[73627]: DEBUG nova.compute.manager [req-1ee248df-8c78-4d22-ba37-3cc7074be85b req-aa8e08c0-00c7-478b-8863-a7f8261b118a service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-vif-plugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee248df-8c78-4d22-ba37-3cc7074be85b req-aa8e08c0-00c7-478b-8863-a7f8261b118a service nova] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee248df-8c78-4d22-ba37-3cc7074be85b req-aa8e08c0-00c7-478b-8863-a7f8261b118a service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee248df-8c78-4d22-ba37-3cc7074be85b req-aa8e08c0-00c7-478b-8863-a7f8261b118a service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:52 user nova-compute[73627]: DEBUG nova.compute.manager [req-1ee248df-8c78-4d22-ba37-3cc7074be85b req-aa8e08c0-00c7-478b-8863-a7f8261b118a service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] No waiting events found dispatching network-vif-plugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:52 user nova-compute[73627]: WARNING nova.compute.manager [req-1ee248df-8c78-4d22-ba37-3cc7074be85b req-aa8e08c0-00c7-478b-8863-a7f8261b118a service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received unexpected event network-vif-plugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 for instance with vm_state active and task_state None.
Aug 26 16:25:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Successfully updated port: a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-43ec364a-9e8f-4885-bb22-46fd7e16b4c2 req-5a80b58b-34cc-4602-b8b1-51ee11efd62c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-43ec364a-9e8f-4885-bb22-46fd7e16b4c2 req-5a80b58b-34cc-4602-b8b1-51ee11efd62c service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-43ec364a-9e8f-4885-bb22-46fd7e16b4c2 req-5a80b58b-34cc-4602-b8b1-51ee11efd62c service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-43ec364a-9e8f-4885-bb22-46fd7e16b4c2 req-5a80b58b-34cc-4602-b8b1-51ee11efd62c service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-43ec364a-9e8f-4885-bb22-46fd7e16b4c2 req-5a80b58b-34cc-4602-b8b1-51ee11efd62c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:53 user nova-compute[73627]: WARNING nova.compute.manager [req-43ec364a-9e8f-4885-bb22-46fd7e16b4c2 req-5a80b58b-34cc-4602-b8b1-51ee11efd62c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-d01767e2-a65b-4bbd-ae31-97eccf191447 for instance with vm_state building and task_state spawning.
Aug 26 16:25:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "refresh_cache-5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquired lock "refresh_cache-5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-72521a43-3795-4e21-af13-c7356b5afb06 req-d2559240-603f-4edc-9d20-ce41e8996a37 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-72521a43-3795-4e21-af13-c7356b5afb06 req-d2559240-603f-4edc-9d20-ce41e8996a37 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-72521a43-3795-4e21-af13-c7356b5afb06 req-d2559240-603f-4edc-9d20-ce41e8996a37 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-72521a43-3795-4e21-af13-c7356b5afb06 req-d2559240-603f-4edc-9d20-ce41e8996a37 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-72521a43-3795-4e21-af13-c7356b5afb06 req-d2559240-603f-4edc-9d20-ce41e8996a37 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:54 user nova-compute[73627]: WARNING nova.compute.manager [req-72521a43-3795-4e21-af13-c7356b5afb06 req-d2559240-603f-4edc-9d20-ce41e8996a37 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 for instance with vm_state building and task_state spawning.
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Updating instance_info_cache with network_info: [{"id": "a71b2faa-f735-4db6-a598-7c86f1330002", "address": "fa:16:3e:da:0b:03", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71b2faa-f7", "ovs_interfaceid": "a71b2faa-f735-4db6-a598-7c86f1330002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Releasing lock "refresh_cache-5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Instance network_info: |[{"id": "a71b2faa-f735-4db6-a598-7c86f1330002", "address": "fa:16:3e:da:0b:03", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71b2faa-f7", "ovs_interfaceid": "a71b2faa-f735-4db6-a598-7c86f1330002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Start _get_guest_xml network_info=[{"id": "a71b2faa-f735-4db6-a598-7c86f1330002", "address": "fa:16:3e:da:0b:03", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71b2faa-f7", "ovs_interfaceid": "a71b2faa-f735-4db6-a598-7c86f1330002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:25:54 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:25:54 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-747050381',display_name='tempest-AttachVolumeNegativeTest-server-747050381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-747050381',id=14,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQQAwgccHYD7pbVY/lg2dEyu3JKFoDadGiGigauAYtETMS2eUeBEXczgaQUtxHYJ//9bjVWbQmxsFGAiON2LBIWeCDR+Oc+VticJUYRd9DQ8mjroAmkdWK/stWazSw3ag==',key_name='tempest-keypair-1880200258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-7ab0109o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:25:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a71b2faa-f735-4db6-a598-7c86f1330002", "address": "fa:16:3e:da:0b:03", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71b2faa-f7", "ovs_interfaceid": "a71b2faa-f735-4db6-a598-7c86f1330002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "a71b2faa-f735-4db6-a598-7c86f1330002", "address": "fa:16:3e:da:0b:03", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71b2faa-f7", "ovs_interfaceid": "a71b2faa-f735-4db6-a598-7c86f1330002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:0b:03,bridge_name='br-int',has_traffic_filtering=True,id=a71b2faa-f735-4db6-a598-7c86f1330002,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71b2faa-f7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.objects.instance [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:25:54 user nova-compute[73627]:   <uuid>5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8</uuid>
Aug 26 16:25:54 user nova-compute[73627]:   <name>instance-0000000e</name>
Aug 26 16:25:54 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:25:54 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:25:54 user nova-compute[73627]:   <metadata>
Aug 26 16:25:54 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:25:54 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:25:54 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeNegativeTest-server-747050381</nova:name>
Aug 26 16:25:54 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:25:54</nova:creationTime>
Aug 26 16:25:54 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:25:54 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:25:54 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:25:54 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:25:54 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:25:54 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:25:54 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:25:54 user nova-compute[73627]:       <nova:owner>
Aug 26 16:25:54 user nova-compute[73627]:         <nova:user uuid="d643e68350c749df9a033c5ee9bae19f">tempest-AttachVolumeNegativeTest-1218878917-project-member</nova:user>
Aug 26 16:25:54 user nova-compute[73627]:         <nova:project uuid="78924631c2e241b0b0c5cb8c9c24b4a4">tempest-AttachVolumeNegativeTest-1218878917</nova:project>
Aug 26 16:25:54 user nova-compute[73627]:       </nova:owner>
Aug 26 16:25:54 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:25:54 user nova-compute[73627]:       <nova:ports>
Aug 26 16:25:54 user nova-compute[73627]:         <nova:port uuid="a71b2faa-f735-4db6-a598-7c86f1330002">
Aug 26 16:25:54 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 16:25:54 user nova-compute[73627]:         </nova:port>
Aug 26 16:25:54 user nova-compute[73627]:       </nova:ports>
Aug 26 16:25:54 user nova-compute[73627]:     </nova:instance>
Aug 26 16:25:54 user nova-compute[73627]:   </metadata>
Aug 26 16:25:54 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:25:54 user nova-compute[73627]:     <system>
Aug 26 16:25:54 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:25:54 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:25:54 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:25:54 user nova-compute[73627]:       <entry name="serial">5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8</entry>
Aug 26 16:25:54 user nova-compute[73627]:       <entry name="uuid">5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8</entry>
Aug 26 16:25:54 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:25:54 user nova-compute[73627]:     </system>
Aug 26 16:25:54 user nova-compute[73627]:   </sysinfo>
Aug 26 16:25:54 user nova-compute[73627]:   <os>
Aug 26 16:25:54 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:25:54 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:25:54 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:25:54 user nova-compute[73627]:   </os>
Aug 26 16:25:54 user nova-compute[73627]:   <features>
Aug 26 16:25:54 user nova-compute[73627]:     <acpi/>
Aug 26 16:25:54 user nova-compute[73627]:     <apic/>
Aug 26 16:25:54 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:25:54 user nova-compute[73627]:   </features>
Aug 26 16:25:54 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:25:54 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:25:54 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:25:54 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:25:54 user nova-compute[73627]:   </clock>
Aug 26 16:25:54 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:25:54 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:25:54 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:25:54 user nova-compute[73627]:   </cpu>
Aug 26 16:25:54 user nova-compute[73627]:   <devices>
Aug 26 16:25:54 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:25:54 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:25:54 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk"/>
Aug 26 16:25:54 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:25:54 user nova-compute[73627]:     </disk>
Aug 26 16:25:54 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:25:54 user nova-compute[73627]:       <mac address="fa:16:3e:da:0b:03"/>
Aug 26 16:25:54 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:54 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:25:54 user nova-compute[73627]:       <target dev="tapa71b2faa-f7"/>
Aug 26 16:25:54 user nova-compute[73627]:     </interface>
Aug 26 16:25:54 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:25:54 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/console.log" append="off"/>
Aug 26 16:25:54 user nova-compute[73627]:     </serial>
Aug 26 16:25:54 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:25:54 user nova-compute[73627]:     <video>
Aug 26 16:25:54 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:25:54 user nova-compute[73627]:     </video>
Aug 26 16:25:54 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:25:54 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:25:54 user nova-compute[73627]:     </rng>
Aug 26 16:25:54 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:25:54 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:25:54 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:25:54 user nova-compute[73627]:     </memballoon>
Aug 26 16:25:54 user nova-compute[73627]:   </devices>
Aug 26 16:25:54 user nova-compute[73627]: </domain>
Aug 26 16:25:54 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-747050381',display_name='tempest-AttachVolumeNegativeTest-server-747050381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-747050381',id=14,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQQAwgccHYD7pbVY/lg2dEyu3JKFoDadGiGigauAYtETMS2eUeBEXczgaQUtxHYJ//9bjVWbQmxsFGAiON2LBIWeCDR+Oc+VticJUYRd9DQ8mjroAmkdWK/stWazSw3ag==',key_name='tempest-keypair-1880200258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-7ab0109o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:25:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a71b2faa-f735-4db6-a598-7c86f1330002", "address": "fa:16:3e:da:0b:03", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71b2faa-f7", "ovs_interfaceid": "a71b2faa-f735-4db6-a598-7c86f1330002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "a71b2faa-f735-4db6-a598-7c86f1330002", "address": "fa:16:3e:da:0b:03", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71b2faa-f7", "ovs_interfaceid": "a71b2faa-f735-4db6-a598-7c86f1330002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:0b:03,bridge_name='br-int',has_traffic_filtering=True,id=a71b2faa-f735-4db6-a598-7c86f1330002,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71b2faa-f7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG os_vif [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:0b:03,bridge_name='br-int',has_traffic_filtering=True,id=a71b2faa-f735-4db6-a598-7c86f1330002,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71b2faa-f7') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa71b2faa-f7, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa71b2faa-f7, col_values=(('external_ids', {'iface-id': 'a71b2faa-f735-4db6-a598-7c86f1330002', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:0b:03', 'vm-uuid': '5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: INFO os_vif [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:0b:03,bridge_name='br-int',has_traffic_filtering=True,id=a71b2faa-f735-4db6-a598-7c86f1330002,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71b2faa-f7')
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No VIF found with MAC fa:16:3e:da:0b:03, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-468cf3cc-271e-4713-8abf-bc6868aee269 req-9f68f5ec-fd8a-4b6f-bfbc-fc7c8572d6f8 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Received event network-changed-a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-468cf3cc-271e-4713-8abf-bc6868aee269 req-9f68f5ec-fd8a-4b6f-bfbc-fc7c8572d6f8 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Refreshing instance network info cache due to event network-changed-a71b2faa-f735-4db6-a598-7c86f1330002. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-468cf3cc-271e-4713-8abf-bc6868aee269 req-9f68f5ec-fd8a-4b6f-bfbc-fc7c8572d6f8 service nova] Acquiring lock "refresh_cache-5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-468cf3cc-271e-4713-8abf-bc6868aee269 req-9f68f5ec-fd8a-4b6f-bfbc-fc7c8572d6f8 service nova] Acquired lock "refresh_cache-5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG nova.network.neutron [req-468cf3cc-271e-4713-8abf-bc6868aee269 req-9f68f5ec-fd8a-4b6f-bfbc-fc7c8572d6f8 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Refreshing network info cache for port a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:25:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG nova.network.neutron [req-468cf3cc-271e-4713-8abf-bc6868aee269 req-9f68f5ec-fd8a-4b6f-bfbc-fc7c8572d6f8 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Updated VIF entry in instance network info cache for port a71b2faa-f735-4db6-a598-7c86f1330002. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG nova.network.neutron [req-468cf3cc-271e-4713-8abf-bc6868aee269 req-9f68f5ec-fd8a-4b6f-bfbc-fc7c8572d6f8 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Updating instance_info_cache with network_info: [{"id": "a71b2faa-f735-4db6-a598-7c86f1330002", "address": "fa:16:3e:da:0b:03", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71b2faa-f7", "ovs_interfaceid": "a71b2faa-f735-4db6-a598-7c86f1330002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-468cf3cc-271e-4713-8abf-bc6868aee269 req-9f68f5ec-fd8a-4b6f-bfbc-fc7c8572d6f8 service nova] Releasing lock "refresh_cache-5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:55 user nova-compute[73627]: WARNING nova.compute.manager [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-d01767e2-a65b-4bbd-ae31-97eccf191447 for instance with vm_state building and task_state spawning.
Aug 26 16:25:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:55 user nova-compute[73627]: WARNING nova.compute.manager [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 for instance with vm_state building and task_state spawning.
Aug 26 16:25:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:55 user nova-compute[73627]: WARNING nova.compute.manager [req-e2841c08-d400-4e0a-ad41-8535801463eb req-3d62f1bb-e7d4-4c7a-9e5c-f55c34696815 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 for instance with vm_state building and task_state spawning.
Aug 26 16:25:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:56 user nova-compute[73627]: WARNING nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 for instance with vm_state building and task_state spawning.
Aug 26 16:25:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:56 user nova-compute[73627]: WARNING nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 for instance with vm_state building and task_state spawning.
Aug 26 16:25:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:56 user nova-compute[73627]: WARNING nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 for instance with vm_state building and task_state spawning.
Aug 26 16:25:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:56 user nova-compute[73627]: WARNING nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-89f0db97-51c1-44f3-8009-1624dfa94db4 for instance with vm_state building and task_state spawning.
Aug 26 16:25:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:56 user nova-compute[73627]: WARNING nova.compute.manager [req-47f721cb-dbd9-4776-bcd5-a12c706ec9d5 req-3fa16019-4947-46b6-8a73-3e7e20f446d6 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-89f0db97-51c1-44f3-8009-1624dfa94db4 for instance with vm_state building and task_state spawning.
Aug 26 16:25:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:57 user nova-compute[73627]: WARNING nova.compute.manager [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 for instance with vm_state building and task_state spawning.
Aug 26 16:25:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:57 user nova-compute[73627]: WARNING nova.compute.manager [req-9e3953eb-5d31-4132-a86c-e11ddae562cb req-5a12c3a7-4dd0-4579-ac9a-c429e0a3c6d2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 for instance with vm_state building and task_state spawning.
Aug 26 16:25:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-896113fb-f01e-400d-9f13-de695b90ee70 req-6a273fa4-edcb-490f-857e-1fda75dfe2c1 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Received event network-vif-plugged-a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-896113fb-f01e-400d-9f13-de695b90ee70 req-6a273fa4-edcb-490f-857e-1fda75dfe2c1 service nova] Acquiring lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-896113fb-f01e-400d-9f13-de695b90ee70 req-6a273fa4-edcb-490f-857e-1fda75dfe2c1 service nova] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-896113fb-f01e-400d-9f13-de695b90ee70 req-6a273fa4-edcb-490f-857e-1fda75dfe2c1 service nova] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-896113fb-f01e-400d-9f13-de695b90ee70 req-6a273fa4-edcb-490f-857e-1fda75dfe2c1 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] No waiting events found dispatching network-vif-plugged-a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:57 user nova-compute[73627]: WARNING nova.compute.manager [req-896113fb-f01e-400d-9f13-de695b90ee70 req-6a273fa4-edcb-490f-857e-1fda75dfe2c1 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Received unexpected event network-vif-plugged-a71b2faa-f735-4db6-a598-7c86f1330002 for instance with vm_state building and task_state spawning.
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:58 user nova-compute[73627]: WARNING nova.compute.manager [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-60158f05-7509-4976-85e8-fdeff3b26a24 for instance with vm_state building and task_state spawning.
Aug 26 16:25:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:58 user nova-compute[73627]: WARNING nova.compute.manager [req-a862d337-25a3-49ca-90d8-509b1eae212a req-f351853b-b2e2-4c98-a2ac-6048eb03771d service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-60158f05-7509-4976-85e8-fdeff3b26a24 for instance with vm_state building and task_state spawning.
Aug 26 16:25:58 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:58 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067159.7457287, 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:25:59 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] VM Resumed (Lifecycle Event)
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:25:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Instance spawned successfully.
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Instance spawned successfully.
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:25:59 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067159.7489445, 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:25:59 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] VM Started (Lifecycle Event)
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-d5fd54f9-2c66-4ec8-8223-536111ddd550 req-79b6591d-a945-4d5a-9d78-51ac03693f4a service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Received event network-vif-plugged-a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d5fd54f9-2c66-4ec8-8223-536111ddd550 req-79b6591d-a945-4d5a-9d78-51ac03693f4a service nova] Acquiring lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d5fd54f9-2c66-4ec8-8223-536111ddd550 req-79b6591d-a945-4d5a-9d78-51ac03693f4a service nova] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d5fd54f9-2c66-4ec8-8223-536111ddd550 req-79b6591d-a945-4d5a-9d78-51ac03693f4a service nova] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-d5fd54f9-2c66-4ec8-8223-536111ddd550 req-79b6591d-a945-4d5a-9d78-51ac03693f4a service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] No waiting events found dispatching network-vif-plugged-a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:25:59 user nova-compute[73627]: WARNING nova.compute.manager [req-d5fd54f9-2c66-4ec8-8223-536111ddd550 req-79b6591d-a945-4d5a-9d78-51ac03693f4a service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Received unexpected event network-vif-plugged-a71b2faa-f735-4db6-a598-7c86f1330002 for instance with vm_state building and task_state spawning.
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:25:59 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067159.7722893, f961b797-16bd-43bd-8735-93578f1084cf => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:25:59 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f961b797-16bd-43bd-8735-93578f1084cf] VM Resumed (Lifecycle Event)
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:25:59 user nova-compute[73627]: INFO nova.compute.manager [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Took 9.33 seconds to spawn the instance on the hypervisor.
Aug 26 16:25:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:00 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f961b797-16bd-43bd-8735-93578f1084cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:26:00 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067159.7758749, f961b797-16bd-43bd-8735-93578f1084cf => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:26:00 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f961b797-16bd-43bd-8735-93578f1084cf] VM Started (Lifecycle Event)
Aug 26 16:26:00 user nova-compute[73627]: INFO nova.compute.manager [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Took 14.36 seconds to spawn the instance on the hypervisor.
Aug 26 16:26:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:26:00 user nova-compute[73627]: INFO nova.compute.manager [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Took 10.52 seconds to build instance.
Aug 26 16:26:00 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f961b797-16bd-43bd-8735-93578f1084cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:26:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f5b78cb3-6d3d-456a-9636-335a1b8f6cb2 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.631s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:00 user nova-compute[73627]: INFO nova.compute.manager [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Took 66.31 seconds to build instance.
Aug 26 16:26:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9acb492f-ac6d-4f40-9395-766ebdb62e60 tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "f961b797-16bd-43bd-8735-93578f1084cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 66.476s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJGMUFrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:03 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:03 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:03 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a22f3d3-9063-41db-a547-ead299130556]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:26:03 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[893dabb4-b1f7-4cbd-bf2f-26f92eb628e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515] added
Aug 26 16:26:03 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[830ba15f-0996-4efc-85ac-082638350fbe]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[317fdbb0-cd02-4136-9199-c02c55e0b6bb]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hJGMUFrq {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hJGMUFrq" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c1c03f-b46c-4768-a0f3-c74558f483c5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hJGMUFrq'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfe271e-98a9-4d85-bed3-2a1b501b3249]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7868cb85-8d4f-453a-bf68-a8214bfdda11]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:03 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG nova.objects.instance [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lazy-loading 'flavor' on Instance uuid 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --login" returned: 0 in 0.121s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ef8f3c-ad1e-4a51-afdf-6f46cc0771fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515, portal: 172.16.0.220,3260]
Aug 26 16:26:04 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515, portal: 172.16.0.220,3260] successful.
Aug 26 16:26:04 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e9d69-855c-4a6f-9bd1-f488abf54df4]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.189s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2fe2f8-495d-4295-a754-72ca57d9dbe2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:04 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.558s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2652c15f-e4c3-4ed9-9d4f-746acd6806f7]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJGMUFrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-50dfe7ae-0091-4252-93f6-1fcaba3870e7 req-898936da-7546-4d6a-80af-b5be1bfa1346 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-changed-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-50dfe7ae-0091-4252-93f6-1fcaba3870e7 req-898936da-7546-4d6a-80af-b5be1bfa1346 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Refreshing instance network info cache due to event network-changed-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-50dfe7ae-0091-4252-93f6-1fcaba3870e7 req-898936da-7546-4d6a-80af-b5be1bfa1346 service nova] Acquiring lock "refresh_cache-f34a8233-5a54-4a28-b57f-096e8526e80e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-50dfe7ae-0091-4252-93f6-1fcaba3870e7 req-898936da-7546-4d6a-80af-b5be1bfa1346 service nova] Acquired lock "refresh_cache-f34a8233-5a54-4a28-b57f-096e8526e80e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-50dfe7ae-0091-4252-93f6-1fcaba3870e7 req-898936da-7546-4d6a-80af-b5be1bfa1346 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Refreshing network info cache for port 8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:04 user nova-compute[73627]: INFO nova.compute.manager [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Attaching volume 365bf35b-01fb-4832-878d-497455702967 to /dev/vdb
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.utils [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[09df427c-6de8-4b59-8a92-b25f9aae3e2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98c1e4a-95ad-40d4-a9d8-d1952bf1725d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[228a4c66-c5aa-44ad-90ae-8e039e3bc3d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcffb39-6191-4008-a731-74dd48ac1b20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:26:04 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf441fa7-e532-4fe0-b357-f7a9deae1386]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG os_brick.utils [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Updating existing volume attachment record: 144a82c3-7aed-4673-8033-6b895d41fd1e {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:26:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.614s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] <== connect_volume: return (1620ms) {'type': 'block', 'scsi_wwn': '23363383336363365', 'path': '/dev/sdj'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363383336363365', 'path': '/dev/sdj'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:26:05 user nova-compute[73627]: DEBUG nova.objects.instance [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lazy-loading 'flavor' on Instance uuid 3b4253a4-1436-4026-8549-f48f1bb8f121 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] attach device xml: <disk type="block" device="disk">
Aug 26 16:26:05 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:05 user nova-compute[73627]:   <source dev="/dev/sdj"/>
Aug 26 16:26:05 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:26:05 user nova-compute[73627]:   <serial>9a5a6f06-ede0-48aa-9c48-87cf782f8515</serial>
Aug 26 16:26:05 user nova-compute[73627]: </disk>
Aug 26 16:26:05 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:26:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-50dfe7ae-0091-4252-93f6-1fcaba3870e7 req-898936da-7546-4d6a-80af-b5be1bfa1346 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Updated VIF entry in instance network info cache for port 8408461f-84dc-4d3c-afa8-c6b8a2b8ab97. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:26:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-50dfe7ae-0091-4252-93f6-1fcaba3870e7 req-898936da-7546-4d6a-80af-b5be1bfa1346 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Updating instance_info_cache with network_info: [{"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:26:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-50dfe7ae-0091-4252-93f6-1fcaba3870e7 req-898936da-7546-4d6a-80af-b5be1bfa1346 service nova] Releasing lock "refresh_cache-f34a8233-5a54-4a28-b57f-096e8526e80e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:26:06 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:26:06 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=6742MB free_disk=25.59471893310547GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] No VIF found with MAC fa:16:3e:7c:c9:53, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zswbugTV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:06 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:06 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:06 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 401459e7-47f6-466a-847f-01c92022bb56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 3b4253a4-1436-4026-8549-f48f1bb8f121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 95c10a06-6846-4106-9c43-37054de6bf94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f34a8233-5a54-4a28-b57f-096e8526e80e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f961b797-16bd-43bd-8735-93578f1084cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[811eefed-7004-4183-b37f-36698ee8d007]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:26:06 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6a3a81-52c6-4f22-afe7-9dbb4d7a4184]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895] added
Aug 26 16:26:06 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4642b1fe-cbca-44df-bc33-31f1f2bd4a24]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4c2a08-3ebc-4631-a7fe-c74fd6729ab3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zswbugTV {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zswbugTV" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[349bf99e-f557-4dad-8914-8a3536a3cacc]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zswbugTV'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f347fe9-68ef-411f-846c-44f024034d06]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c45705-2cab-4f18-bcd3-b927bba1952c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQAlutaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:07 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-34297e43-b59a-440e-afae-24951c61a0e0 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.152s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --login" returned: 0 in 0.147s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3677034c-da1a-439e-b49c-5c03a33327dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895, portal: 172.16.0.220,3260]
Aug 26 16:26:07 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895, portal: 172.16.0.220,3260] successful.
Aug 26 16:26:07 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f959656d-87fe-4124-9a10-12b20ddea8ed]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[39617a9a-1692-4fa3-ae44-b8173ea5ecd2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:07 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.523s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6154c30-76d7-4115-9698-08ac92160e3a]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zswbugTV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:07 user nova-compute[73627]: INFO nova.compute.manager [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Rebuilding instance
Aug 26 16:26:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-f8a7dff3-070c-40a8-b75b-739b75402a4d req-2c4742b5-7299-490e-9ab4-f82ead92d920 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-vif-unplugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f8a7dff3-070c-40a8-b75b-739b75402a4d req-2c4742b5-7299-490e-9ab4-f82ead92d920 service nova] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f8a7dff3-070c-40a8-b75b-739b75402a4d req-2c4742b5-7299-490e-9ab4-f82ead92d920 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f8a7dff3-070c-40a8-b75b-739b75402a4d req-2c4742b5-7299-490e-9ab4-f82ead92d920 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-f8a7dff3-070c-40a8-b75b-739b75402a4d req-2c4742b5-7299-490e-9ab4-f82ead92d920 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] No waiting events found dispatching network-vif-unplugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:08 user nova-compute[73627]: WARNING nova.compute.manager [req-f8a7dff3-070c-40a8-b75b-739b75402a4d req-2c4742b5-7299-490e-9ab4-f82ead92d920 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received unexpected event network-vif-unplugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 for instance with vm_state active and task_state rebuilding.
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.578s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] <== connect_volume: return (1580ms) {'type': 'block', 'scsi_wwn': '23662353137663131', 'path': '/dev/sdk'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662353137663131', 'path': '/dev/sdk'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.297s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:08 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:08 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG nova.objects.instance [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lazy-loading 'flavor' on Instance uuid 19fcf882-d14e-4478-aed6-5e30db7d3e33 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf599b5-2333-4f6f-87ae-aa5abc71c630]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:26:08 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:26:08 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:08 user nova-compute[73627]:   <source dev="/dev/sdk"/>
Aug 26 16:26:08 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:26:08 user nova-compute[73627]:   <serial>d5596d83-c680-4402-97c4-a49fbb258895</serial>
Aug 26 16:26:08 user nova-compute[73627]: </disk>
Aug 26 16:26:08 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb40b7d7-f0df-4d62-bd02-d20b7bd93191]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340] added
Aug 26 16:26:08 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b049e2b7-fce5-4f51-ab57-eeb26fab9345]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd66242-1077-4088-bd81-45c65f5466e3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQAlutaD {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQAlutaD" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[95573aa3-36a3-4b5b-9fa3-1d45d29163b0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qQAlutaD'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f97e96d-8a9e-4595-8d13-7337c9eb2ab9]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-92018baf-c7a0-450a-bcb0-a0398aba89aa tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] volume_snapshot_create: create_info: {'snapshot_id': '4fc47ecd-6f15-4bb3-b5d9-802b12aa1a95', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73627) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-92018baf-c7a0-450a-bcb0-a0398aba89aa tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] snap xml: <domainsnapshot>
Aug 26 16:26:08 user nova-compute[73627]:   <disks>
Aug 26 16:26:08 user nova-compute[73627]:     <disk name="/dev/sdj" snapshot="external" type="file">
Aug 26 16:26:08 user nova-compute[73627]:       <source file="/dev/new_file"/>
Aug 26 16:26:08 user nova-compute[73627]:     </disk>
Aug 26 16:26:08 user nova-compute[73627]:     <disk name="vda" snapshot="no"/>
Aug 26 16:26:08 user nova-compute[73627]:   </disks>
Aug 26 16:26:08 user nova-compute[73627]: </domainsnapshot>
Aug 26 16:26:08 user nova-compute[73627]:  {{(pid=73627) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG nova.objects.instance [None req-92018baf-c7a0-450a-bcb0-a0398aba89aa tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] Lazy-loading 'system_metadata' on Instance uuid 3b4253a4-1436-4026-8549-f48f1bb8f121 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.078s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3495aa72-7afa-42e7-8c9f-caec84d13cf5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:08 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:08 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-92018baf-c7a0-450a-bcb0-a0398aba89aa tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [None req-92018baf-c7a0-450a-bcb0-a0398aba89aa tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Traceback (most recent call last):
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     rv = execute(f, *args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     six.reraise(c, e, tb)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     raise value
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     rv = meth(*args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] 
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [None req-92018baf-c7a0-450a-bcb0-a0398aba89aa tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Traceback (most recent call last):
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     self._volume_snapshot_create(context, instance, guest,
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     rv = execute(f, *args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     six.reraise(c, e, tb)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     raise value
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     rv = meth(*args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] 
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --login" returned: 0 in 0.176s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e2771e-4ae9-455e-8682-ca9cd03b2b94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340, portal: 172.16.0.220,3260]
Aug 26 16:26:08 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340, portal: 172.16.0.220,3260] successful.
Aug 26 16:26:08 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-473e4427-d9d5-450f-a88b-b5bad93d5ebe tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] volume_snapshot_delete: delete_info: {'volume_id': '9a5a6f06-ede0-48aa-9c48-87cf782f8515'} {{(pid=73627) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [None req-473e4427-d9d5-450f-a88b-b5bad93d5ebe tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Traceback (most recent call last):
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121]     if delete_info['type'] != 'qcow2':
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] KeyError: 'type'
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] 
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "612978f6-a682-4bd5-935a-53aaa2c1f352" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "612978f6-a682-4bd5-935a-53aaa2c1f352" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af159a9-544d-43bb-9380-4f22fc1ad069]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [None req-92018baf-c7a0-450a-bcb0-a0398aba89aa tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 4fc47ecd-6f15-4bb3-b5d9-802b12aa1a95 could not be found.
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     raise value
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver 
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver 
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 4fc47ecd-6f15-4bb3-b5d9-802b12aa1a95 could not be found. (HTTP 404) (Request-ID: req-01fa6fa9-7c01-4473-a012-02b2a216a3ad)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver 
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver 
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 4fc47ecd-6f15-4bb3-b5d9-802b12aa1a95 could not be found.
Aug 26 16:26:08 user nova-compute[73627]: ERROR nova.virt.libvirt.driver 
Aug 26 16:26:08 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver [None req-473e4427-d9d5-450f-a88b-b5bad93d5ebe tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver 
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver 
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-8a1fbd00-8432-40cf-a80c-e431fd3e7ed3)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver 
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver 
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 16:26:09 user nova-compute[73627]: ERROR nova.virt.libvirt.driver 
Aug 26 16:26:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.106s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1961ac45-022f-4c94-a777-012726e71b13]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.739s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server [None req-92018baf-c7a0-450a-bcb0-a0398aba89aa tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise value
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server 
Aug 26 16:26:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server [None req-473e4427-d9d5-450f-a88b-b5bad93d5ebe tempest-VolumesAssistedSnapshotsTest-1798575832 tempest-VolumesAssistedSnapshotsTest-1798575832-project] Exception during message handling: KeyError: 'type'
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 26 16:26:09 user nova-compute[73627]: ERROR oslo_messaging.rpc.server 
Aug 26 16:26:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9abf4c-c2b8-4617-a12f-96d9d4e1d510]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Connected to sdl using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQAlutaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:26:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Instance destroyed successfully.
Aug 26 16:26:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Instance destroyed successfully.
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-305755365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-221217757',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZg30xf6ADFM2OrxzbSgKjl2I1mfRaXR7ksJbPemPRCTfCXrd27g1yT4kPNFBVdl+SB80btIVwzCgShhqlwfrFbHefKSSkDAwBQ1ev0GfUUbSpBCNWTJ8+qVVI2IoozJQ==',key_name='tempest-keypair-661931287',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:24:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1c0c3d55d3c488a978986d609f8bdb9',ramdisk_id='',reservation_id='r-lj2vpcg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-332170589',owner_user_name='tempest-ServerActionsV293TestJSON-332170589-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063c3d4f532c4a3da674054d3dfeb5de',uuid=f34a8233-5a54-4a28-b57f-096e8526e80e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converting VIF {"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG os_vif [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8408461f-84, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:09 user nova-compute[73627]: INFO os_vif [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84')
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEWqVeDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:09 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 16:26:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:26:09 user nova-compute[73627]: INFO nova.compute.claims [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Claim successful on node user
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] No VIF found with MAC fa:16:3e:c0:cd:01, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57bc7f88-62c4-45fd-9388-81fe365464d3 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.709s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Acquiring lock "3b4253a4-1436-4026-8549-f48f1bb8f121" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:09 user nova-compute[73627]: INFO nova.compute.manager [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Detaching volume 9a5a6f06-ede0-48aa-9c48-87cf782f8515
Aug 26 16:26:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:09 user nova-compute[73627]: INFO nova.virt.block_device [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Attempting to driver detach volume 9a5a6f06-ede0-48aa-9c48-87cf782f8515 from mountpoint /dev/vdb
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Attempting to detach device vdb from instance 3b4253a4-1436-4026-8549-f48f1bb8f121 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 16:26:09 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:09 user nova-compute[73627]:   <source dev="/dev/sdj"/>
Aug 26 16:26:09 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:26:09 user nova-compute[73627]:   <serial>9a5a6f06-ede0-48aa-9c48-87cf782f8515</serial>
Aug 26 16:26:09 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:26:09 user nova-compute[73627]: </disk>
Aug 26 16:26:09 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:26:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Successfully detached device vdb from instance 3b4253a4-1436-4026-8549-f48f1bb8f121 from the persistent domain config.
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b4253a4-1436-4026-8549-f48f1bb8f121 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 16:26:09 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:09 user nova-compute[73627]:   <source dev="/dev/sdj"/>
Aug 26 16:26:09 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:26:09 user nova-compute[73627]:   <serial>9a5a6f06-ede0-48aa-9c48-87cf782f8515</serial>
Aug 26 16:26:09 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:26:09 user nova-compute[73627]: </disk>
Aug 26 16:26:09 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:26:09 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.843s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.806s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] <== connect_volume: return (3104ms) {'type': 'block', 'scsi_wwn': '23234316131393262', 'path': '/dev/sdl'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234316131393262', 'path': '/dev/sdl'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.955s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:26:10 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lazy-loading 'flavor' on Instance uuid 401459e7-47f6-466a-847f-01c92022bb56 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[79652d4f-c398-4336-ae80-33cf48225397]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c2ee14-2bbb-4c92-844e-77af730e3397]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d03e64d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: INFO nova.virt.block_device [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Booting with blank volume at /dev/vda
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.policy [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f24169ea97724e1288631ea977a068bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b8b30c15b8423e90156082111b000f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:26:10 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:10 user nova-compute[73627]:   <source dev="/dev/sdl"/>
Aug 26 16:26:10 user nova-compute[73627]:   <target dev="sdc" bus="scsi"/>
Aug 26 16:26:10 user nova-compute[73627]:   <serial>43f1340c-a551-4e7c-bd3d-d376674b6340</serial>
Aug 26 16:26:10 user nova-compute[73627]:   <address type="drive" controller="0" unit="2"/>
Aug 26 16:26:10 user nova-compute[73627]: </disk>
Aug 26 16:26:10 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-b75c7bce-6c9a-41d9-967b-a73568e108ef req-5af99235-8175-49b5-9e91-b4af892f5d3d service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b75c7bce-6c9a-41d9-967b-a73568e108ef req-5af99235-8175-49b5-9e91-b4af892f5d3d service nova] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b75c7bce-6c9a-41d9-967b-a73568e108ef req-5af99235-8175-49b5-9e91-b4af892f5d3d service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b75c7bce-6c9a-41d9-967b-a73568e108ef req-5af99235-8175-49b5-9e91-b4af892f5d3d service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-b75c7bce-6c9a-41d9-967b-a73568e108ef req-5af99235-8175-49b5-9e91-b4af892f5d3d service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] No waiting events found dispatching network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:10 user nova-compute[73627]: WARNING nova.compute.manager [req-b75c7bce-6c9a-41d9-967b-a73568e108ef req-5af99235-8175-49b5-9e91-b4af892f5d3d service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received unexpected event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 for instance with vm_state active and task_state rebuilding.
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067170.2907443, 3b4253a4-1436-4026-8549-f48f1bb8f121 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b4253a4-1436-4026-8549-f48f1bb8f121 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[da71533f-272c-43d1-89e1-a2ba3b8d1285]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Successfully detached device vdb from instance 3b4253a4-1436-4026-8549-f48f1bb8f121 from the live domain config.
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJGMUFrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:10 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fae06d-5331-4dc0-8003-347497aff9a4]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[419b6666-1954-42f5-8cd4-6e58001b90d8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01bc292-82e9-43f2-bfbb-048e02e14d4d]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a11aead-2f33-47b9-8207-74a5c4b49f74]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[039bc4ac-0705-493f-bb28-520a7f5d84cc]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260]
Aug 26 16:26:10 user nova-compute[73627]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260] successful.
Aug 26 16:26:10 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.071s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fbc7e1-9862-4077-9620-ad9987c22b7a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.535s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] <== disconnect_volume: return (1490ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:26:10 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Deleting instance files /opt/stack/data/nova/instances/f34a8233-5a54-4a28-b57f-096e8526e80e_del
Aug 26 16:26:10 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Deletion of /opt/stack/data/nova/instances/f34a8233-5a54-4a28-b57f-096e8526e80e_del complete
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.360s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[43751f05-8da7-449d-aba7-b694465b348c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82f5b26-db12-404c-9cd7-0da409f6adcd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:10 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3f6fd7490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515'): ({'sdj'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Removing single pathed devices sdj {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c8d0b1-5210-477f-be06-26d21c415db5]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78badd8-8605-47bb-b20a-129903069469]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Flushing IO for device /dev/sdj {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] No BDM found with device name sda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] No VIF found with MAC fa:16:3e:3f:e1:88, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcf398b-436a-4509-8b0c-8ed76506e26f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.097s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c992fbde-0a54-4cb6-9c7c-b581d9d3ab1a]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] SCSI volumes sdj have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:26:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[546431d8-8e46-41bd-b885-0e0101ff8501]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Successfully created port: 532ad4a2-862b-4f70-95cb-7e7228616f1a {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:26:11 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance f34a8233-5a54-4a28-b57f-096e8526e80e could not be found.
Aug 26 16:26:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEWqVeDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:11 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --logout" returned: 0 in 0.116s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c5e351a-4c48-4fed-bc91-3a0cd1c0f85e tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.260s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8bc609-d918-4af5-9b49-061079a69efe]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515, portal: 172.16.0.220,3260]
Aug 26 16:26:11 user nova-compute[73627]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515, portal: 172.16.0.220,3260] successful.
Aug 26 16:26:11 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a5a6f06-ede0-48aa-9c48-87cf782f8515 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.061s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b15302-e266-4173-9848-451f65254dcd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.531s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] <== disconnect_volume: return (890ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.097s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1173e8d3-f3e4-4015-97d6-5e8b6550a075]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[549913e3-da96-49bd-96c4-b9fd1a285fcd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:11 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e83992d0>, {}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Disconnecting from: [] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] <== disconnect_volume: return (194ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:11 user nova-compute[73627]: INFO nova.compute.manager [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Detaching volume d5596d83-c680-4402-97c4-a49fbb258895
Aug 26 16:26:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updating instance_info_cache with network_info: [{"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:26:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Successfully updated port: 532ad4a2-862b-4f70-95cb-7e7228616f1a {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "refresh_cache-612978f6-a682-4bd5-935a-53aaa2c1f352" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquired lock "refresh_cache-612978f6-a682-4bd5-935a-53aaa2c1f352" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-eb3a192f-8479-443e-a1ff-9ec64ffcfad4 req-15afcf6c-fa51-414d-9fda-57d8c06f7791 service nova] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Received event network-changed-532ad4a2-862b-4f70-95cb-7e7228616f1a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-eb3a192f-8479-443e-a1ff-9ec64ffcfad4 req-15afcf6c-fa51-414d-9fda-57d8c06f7791 service nova] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Refreshing instance network info cache due to event network-changed-532ad4a2-862b-4f70-95cb-7e7228616f1a. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-eb3a192f-8479-443e-a1ff-9ec64ffcfad4 req-15afcf6c-fa51-414d-9fda-57d8c06f7791 service nova] Acquiring lock "refresh_cache-612978f6-a682-4bd5-935a-53aaa2c1f352" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Updating instance_info_cache with network_info: [{"id": "532ad4a2-862b-4f70-95cb-7e7228616f1a", "address": "fa:16:3e:60:12:60", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ad4a2-86", "ovs_interfaceid": "532ad4a2-862b-4f70-95cb-7e7228616f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Releasing lock "refresh_cache-612978f6-a682-4bd5-935a-53aaa2c1f352" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Instance network_info: |[{"id": "532ad4a2-862b-4f70-95cb-7e7228616f1a", "address": "fa:16:3e:60:12:60", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ad4a2-86", "ovs_interfaceid": "532ad4a2-862b-4f70-95cb-7e7228616f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-eb3a192f-8479-443e-a1ff-9ec64ffcfad4 req-15afcf6c-fa51-414d-9fda-57d8c06f7791 service nova] Acquired lock "refresh_cache-612978f6-a682-4bd5-935a-53aaa2c1f352" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-eb3a192f-8479-443e-a1ff-9ec64ffcfad4 req-15afcf6c-fa51-414d-9fda-57d8c06f7791 service nova] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Refreshing network info cache for port 532ad4a2-862b-4f70-95cb-7e7228616f1a {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lazy-loading 'flavor' on Instance uuid 3b4253a4-1436-4026-8549-f48f1bb8f121 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e1f4a91-fe1e-444b-8a58-f11710c31601 tempest-VolumesAssistedSnapshotsTest-1992555518 tempest-VolumesAssistedSnapshotsTest-1992555518-project-admin] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.312s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:13 user nova-compute[73627]: INFO nova.virt.block_device [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Attempting to driver detach volume d5596d83-c680-4402-97c4-a49fbb258895 from mountpoint /dev/vdb
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Attempting to detach device vdb from instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:26:13 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:13 user nova-compute[73627]:   <source dev="/dev/sdk"/>
Aug 26 16:26:13 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:26:13 user nova-compute[73627]:   <serial>d5596d83-c680-4402-97c4-a49fbb258895</serial>
Aug 26 16:26:13 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:26:13 user nova-compute[73627]: </disk>
Aug 26 16:26:13 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:26:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Successfully detached device vdb from instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 from the persistent domain config.
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:26:13 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:13 user nova-compute[73627]:   <source dev="/dev/sdk"/>
Aug 26 16:26:13 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:26:13 user nova-compute[73627]:   <serial>d5596d83-c680-4402-97c4-a49fbb258895</serial>
Aug 26 16:26:13 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:26:13 user nova-compute[73627]: </disk>
Aug 26 16:26:13 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Preparing to wait for external event volume-reimaged-d582e6d4-e3f2-4216-8fa6-26ccfbc29578 {{(pid=73627) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.network.neutron [req-eb3a192f-8479-443e-a1ff-9ec64ffcfad4 req-15afcf6c-fa51-414d-9fda-57d8c06f7791 service nova] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Updated VIF entry in instance network info cache for port 532ad4a2-862b-4f70-95cb-7e7228616f1a. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.network.neutron [req-eb3a192f-8479-443e-a1ff-9ec64ffcfad4 req-15afcf6c-fa51-414d-9fda-57d8c06f7791 service nova] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Updating instance_info_cache with network_info: [{"id": "532ad4a2-862b-4f70-95cb-7e7228616f1a", "address": "fa:16:3e:60:12:60", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ad4a2-86", "ovs_interfaceid": "532ad4a2-862b-4f70-95cb-7e7228616f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-eb3a192f-8479-443e-a1ff-9ec64ffcfad4 req-15afcf6c-fa51-414d-9fda-57d8c06f7791 service nova] Releasing lock "refresh_cache-612978f6-a682-4bd5-935a-53aaa2c1f352" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067173.657067, 19fcf882-d14e-4478-aed6-5e30db7d3e33 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:26:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Successfully detached device vdb from instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 from the live domain config.
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zswbugTV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:13 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:13 user nova-compute[73627]: INFO nova.compute.manager [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Detaching volume 43f1340c-a551-4e7c-bd3d-d376674b6340
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2865162c-56c8-442f-a1bf-d2a44c1137cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9184ade5-25fd-4163-80df-5970937f56c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:13 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d03e69e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895'): ({'sdk'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Removing single pathed devices sdk {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:26:13 user nova-compute[73627]: INFO nova.virt.block_device [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Attempting to driver detach volume 43f1340c-a551-4e7c-bd3d-d376674b6340 from mountpoint /dev/sdc
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Attempting to detach device sdc from instance 401459e7-47f6-466a-847f-01c92022bb56 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:26:13 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:13 user nova-compute[73627]:   <source dev="/dev/sdl"/>
Aug 26 16:26:13 user nova-compute[73627]:   <target dev="sdc" bus="scsi"/>
Aug 26 16:26:13 user nova-compute[73627]:   <serial>43f1340c-a551-4e7c-bd3d-d376674b6340</serial>
Aug 26 16:26:13 user nova-compute[73627]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 16:26:13 user nova-compute[73627]: </disk>
Aug 26 16:26:13 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[831b8c2f-4a49-4785-b185-52597a1348d3]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Successfully detached device sdc from instance 401459e7-47f6-466a-847f-01c92022bb56 from the persistent domain config.
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 401459e7-47f6-466a-847f-01c92022bb56 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:26:13 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:13 user nova-compute[73627]:   <source dev="/dev/sdl"/>
Aug 26 16:26:13 user nova-compute[73627]:   <target dev="sdc" bus="scsi"/>
Aug 26 16:26:13 user nova-compute[73627]:   <serial>43f1340c-a551-4e7c-bd3d-d376674b6340</serial>
Aug 26 16:26:13 user nova-compute[73627]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 16:26:13 user nova-compute[73627]: </disk>
Aug 26 16:26:13 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.071s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e6c4f-425f-4740-9a99-cba8a83e396d]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Flushing IO for device /dev/sdk {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8e1b45-da95-4b68-b309-eeb0b5058dc7]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b991e57-d775-48a2-aa51-6fccd71fda75]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] SCSI volumes sdk have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2262c30-8a9b-49f2-a2cb-652f5d9f2fc9]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d9b41e-b579-45f0-9ec8-18fab8dadae9]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895, portal: 172.16.0.220,3260]
Aug 26 16:26:14 user nova-compute[73627]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895, portal: 172.16.0.220,3260] successful.
Aug 26 16:26:14 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5596d83-c680-4402-97c4-a49fbb258895 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e799aaf0-50a0-41f2-9110-8b51239f4ee7]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] <== disconnect_volume: return (439ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067174.2238019, 401459e7-47f6-466a-847f-01c92022bb56 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 401459e7-47f6-466a-847f-01c92022bb56 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:26:14 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Successfully detached device sdc from instance 401459e7-47f6-466a-847f-01c92022bb56 from the live domain config.
Aug 26 16:26:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQAlutaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:14 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b709dc-7b02-4737-8597-0bbf0b589d08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20d83d7-edd2-46d2-bff3-c45caeecb4fd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:14 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d04b2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340'): ({'sdl'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Removing single pathed devices sdl {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3ccabe-bb83-4abe-800b-db4bbc1067b4]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aec6448-eaa7-43d9-9a9b-e2fb70eb7282]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Flushing IO for device /dev/sdl {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1b7c35-fd4a-4c3d-8386-1daffaf0b70b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.048s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[956ee213-9d34-48a9-bcf0-cf1358bcceeb]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] SCSI volumes sdl have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66acd6a-faf1-4dfb-b014-1e7e86f9f176]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[245e13ef-d801-477b-a6c2-963f454a43de]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340, portal: 172.16.0.220,3260]
Aug 26 16:26:14 user nova-compute[73627]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340, portal: 172.16.0.220,3260] successful.
Aug 26 16:26:14 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43f1340c-a551-4e7c-bd3d-d376674b6340 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[34495ca4-2eef-4fdd-b1df-cbb6460c4ee4]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] <== disconnect_volume: return (333ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:26:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:15 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lazy-loading 'flavor' on Instance uuid 401459e7-47f6-466a-847f-01c92022bb56 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e1c73e32-844e-4af2-9115-3f855bb17302 tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.318s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG os_brick.utils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1da4c4e-f470-4ca9-8b58-2219113e210f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba92c020-5238-43b3-b42c-f90d35887b89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab61f4e5-3b9f-41b6-8f76-c9c7632d4c7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af77f07-d5ea-4e36-955d-71f2f4644c8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:26:16 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e4587c-b637-49c5-87ff-7d65d01bece1]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG os_brick.utils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Updating existing volume attachment record: 532fecc3-f4a8-4fc4-8835-63deb3c283b5 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:16 user nova-compute[73627]: INFO nova.compute.manager [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Terminating instance
Aug 26 16:26:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-15c7e0cb-9e18-46d1-a991-0f297605d233 req-ae76d8a3-454b-4f14-a246-3a275c6af8eb service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-vif-unplugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-15c7e0cb-9e18-46d1-a991-0f297605d233 req-ae76d8a3-454b-4f14-a246-3a275c6af8eb service nova] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-15c7e0cb-9e18-46d1-a991-0f297605d233 req-ae76d8a3-454b-4f14-a246-3a275c6af8eb service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-15c7e0cb-9e18-46d1-a991-0f297605d233 req-ae76d8a3-454b-4f14-a246-3a275c6af8eb service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-15c7e0cb-9e18-46d1-a991-0f297605d233 req-ae76d8a3-454b-4f14-a246-3a275c6af8eb service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] No waiting events found dispatching network-vif-unplugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-15c7e0cb-9e18-46d1-a991-0f297605d233 req-ae76d8a3-454b-4f14-a246-3a275c6af8eb service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-vif-unplugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Instance destroyed successfully.
Aug 26 16:26:17 user nova-compute[73627]: DEBUG nova.objects.instance [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lazy-loading 'resources' on Instance uuid 401459e7-47f6-466a-847f-01c92022bb56 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-617912877',display_name='tempest-AttachSCSIVolumeTestJSON-server-617912877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-617912877',id=7,image_ref='07e39b91-2604-443e-b035-b8b374212bf2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/Tc0Kb6xOrYkdhJ7JIfPcSvFv4fmD91BBKlV+qGMdI2O4IKYwggpJpYlHb23YSJUEYLlkfIT7WLA50MtzESFTJL6iXmYa3yE0RG3GpqGnBMDG2ojob3+blzTVBln4AvQ==',key_name='tempest-keypair-947301850',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:23:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d458207e23cf4a2384c64470098cd200',ramdisk_id='',reservation_id='r-q88ohuf8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='07e39b91-2604-443e-b035-b8b374212bf2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2114073205',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2114073205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:23:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='694c2459399747a68473234d3c41d24e',uuid=401459e7-47f6-466a-847f-01c92022bb56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "address": "fa:16:3e:3f:e1:88", "network": {"id": "90399b68-638c-4049-a4be-633201cdae4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-176014943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d458207e23cf4a2384c64470098cd200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8460694d-a0", "ovs_interfaceid": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Converting VIF {"id": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "address": "fa:16:3e:3f:e1:88", "network": {"id": "90399b68-638c-4049-a4be-633201cdae4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-176014943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d458207e23cf4a2384c64470098cd200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8460694d-a0", "ovs_interfaceid": "8460694d-a04c-490a-99d0-2c84dac1ecb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=8460694d-a04c-490a-99d0-2c84dac1ecb2,network=Network(90399b68-638c-4049-a4be-633201cdae4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8460694d-a0') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG os_vif [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=8460694d-a04c-490a-99d0-2c84dac1ecb2,network=Network(90399b68-638c-4049-a4be-633201cdae4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8460694d-a0') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8460694d-a0, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:17 user nova-compute[73627]: INFO os_vif [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=8460694d-a04c-490a-99d0-2c84dac1ecb2,network=Network(90399b68-638c-4049-a4be-633201cdae4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8460694d-a0')
Aug 26 16:26:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Deleting instance files /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56_del
Aug 26 16:26:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Deletion of /opt/stack/data/nova/instances/401459e7-47f6-466a-847f-01c92022bb56_del complete
Aug 26 16:26:17 user nova-compute[73627]: INFO nova.compute.manager [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 26 16:26:17 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:26:17 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 401459e7-47f6-466a-847f-01c92022bb56] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:26:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:26:19 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Took 1.64 seconds to deallocate network for instance.
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] No waiting events found dispatching network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:19 user nova-compute[73627]: WARNING nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received unexpected event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 for instance with vm_state deleted and task_state None.
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] No waiting events found dispatching network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:19 user nova-compute[73627]: WARNING nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received unexpected event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 for instance with vm_state deleted and task_state None.
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] No waiting events found dispatching network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:19 user nova-compute[73627]: WARNING nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received unexpected event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 for instance with vm_state deleted and task_state None.
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-vif-unplugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] No waiting events found dispatching network-vif-unplugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:19 user nova-compute[73627]: WARNING nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received unexpected event network-vif-unplugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 for instance with vm_state deleted and task_state None.
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Acquiring lock "401459e7-47f6-466a-847f-01c92022bb56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] Lock "401459e7-47f6-466a-847f-01c92022bb56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] No waiting events found dispatching network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:19 user nova-compute[73627]: WARNING nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received unexpected event network-vif-plugged-8460694d-a04c-490a-99d0-2c84dac1ecb2 for instance with vm_state deleted and task_state None.
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-aec797ff-9b57-43c0-901c-62ca6a7f9408 req-2154c6e1-2821-4622-a74a-82253d91fcd2 service nova] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Received event network-vif-deleted-8460694d-a04c-490a-99d0-2c84dac1ecb2 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.528s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:19 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Deleted allocations for instance 401459e7-47f6-466a-847f-01c92022bb56
Aug 26 16:26:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22649d58-4cbd-423a-ab51-52181a1be57a tempest-AttachSCSIVolumeTestJSON-2114073205 tempest-AttachSCSIVolumeTestJSON-2114073205-project-member] Lock "401459e7-47f6-466a-847f-01c92022bb56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.404s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlbIPCZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:21 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:21 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:21 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd82618e-70d1-4491-99fe-b573b2288249]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:26:21 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b815b6a-2018-426a-b8bc-6e12cd827944]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967] added
Aug 26 16:26:21 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c614b077-4dba-4a01-8c8f-0de95a2b2505]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ec123f-bfff-4c9d-acf1-0d31b555c3a6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlbIPCZn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlbIPCZn" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d8f277-9788-418e-8eae-80bfbce498b8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dlbIPCZn'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a537afe3-c903-4efb-ab16-56a07b47da12]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Acquiring lock "95c10a06-6846-4106-9c43-37054de6bf94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "95c10a06-6846-4106-9c43-37054de6bf94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Acquiring lock "95c10a06-6846-4106-9c43-37054de6bf94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "95c10a06-6846-4106-9c43-37054de6bf94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "95c10a06-6846-4106-9c43-37054de6bf94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:21 user nova-compute[73627]: INFO nova.compute.manager [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Terminating instance
Aug 26 16:26:21 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bede89f-336c-479b-92ac-0d62ddd34ab6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bd6a43-7411-485b-ba8f-9bb1f24b4e58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967, portal: 172.16.0.220,3260]
Aug 26 16:26:21 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967, portal: 172.16.0.220,3260] successful.
Aug 26 16:26:21 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c515780-05c2-4a39-a223-d1c7b8c1725e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7af0e09-f130-4af2-90cc-9398ef618d87]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:21 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4939c2cb-f27e-4ab2-9f93-b9808aff202b]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:21 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:26:22 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Instance destroyed successfully.
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lazy-loading 'resources' on Instance uuid 95c10a06-6846-4106-9c43-37054de6bf94 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1277851994',display_name='tempest-VolumesActionsTest-instance-1277851994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1277851994',id=10,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:24:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='807f21f8623644f4adfc851524cf974b',ramdisk_id='',reservation_id='r-6wa1815o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1463312229',owner_user_name='tempest-VolumesActionsTest-1463312229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:24:15Z,user_data=None,user_id='d968fc519cf14e3489aa16781eaa3915',uuid=95c10a06-6846-4106-9c43-37054de6bf94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b08cafe-7e41-42b8-8292-62a1396074f3", "address": "fa:16:3e:e4:a4:e8", "network": {"id": "a5038e91-bfa4-45bf-8561-a51eea0b0d25", "bridge": "br-int", "label": "tempest-VolumesActionsTest-380490097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "807f21f8623644f4adfc851524cf974b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b08cafe-7e", "ovs_interfaceid": "8b08cafe-7e41-42b8-8292-62a1396074f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Converting VIF {"id": "8b08cafe-7e41-42b8-8292-62a1396074f3", "address": "fa:16:3e:e4:a4:e8", "network": {"id": "a5038e91-bfa4-45bf-8561-a51eea0b0d25", "bridge": "br-int", "label": "tempest-VolumesActionsTest-380490097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "807f21f8623644f4adfc851524cf974b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b08cafe-7e", "ovs_interfaceid": "8b08cafe-7e41-42b8-8292-62a1396074f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a4:e8,bridge_name='br-int',has_traffic_filtering=True,id=8b08cafe-7e41-42b8-8292-62a1396074f3,network=Network(a5038e91-bfa4-45bf-8561-a51eea0b0d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b08cafe-7e') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG os_vif [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a4:e8,bridge_name='br-int',has_traffic_filtering=True,id=8b08cafe-7e41-42b8-8292-62a1396074f3,network=Network(a5038e91-bfa4-45bf-8561-a51eea0b0d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b08cafe-7e') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b08cafe-7e, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:22 user nova-compute[73627]: INFO os_vif [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a4:e8,bridge_name='br-int',has_traffic_filtering=True,id=8b08cafe-7e41-42b8-8292-62a1396074f3,network=Network(a5038e91-bfa4-45bf-8561-a51eea0b0d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b08cafe-7e')
Aug 26 16:26:22 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Deleting instance files /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94_del
Aug 26 16:26:22 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Deletion of /opt/stack/data/nova/instances/95c10a06-6846-4106-9c43-37054de6bf94_del complete
Aug 26 16:26:22 user nova-compute[73627]: INFO nova.compute.manager [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 16:26:22 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-21e29504-f716-46cb-8dd0-5b10e6251d12 req-faad0fea-9135-4a3f-9910-c385d2114ff0 service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Received event network-vif-unplugged-8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-21e29504-f716-46cb-8dd0-5b10e6251d12 req-faad0fea-9135-4a3f-9910-c385d2114ff0 service nova] Acquiring lock "95c10a06-6846-4106-9c43-37054de6bf94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-21e29504-f716-46cb-8dd0-5b10e6251d12 req-faad0fea-9135-4a3f-9910-c385d2114ff0 service nova] Lock "95c10a06-6846-4106-9c43-37054de6bf94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-21e29504-f716-46cb-8dd0-5b10e6251d12 req-faad0fea-9135-4a3f-9910-c385d2114ff0 service nova] Lock "95c10a06-6846-4106-9c43-37054de6bf94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-21e29504-f716-46cb-8dd0-5b10e6251d12 req-faad0fea-9135-4a3f-9910-c385d2114ff0 service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] No waiting events found dispatching network-vif-unplugged-8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-21e29504-f716-46cb-8dd0-5b10e6251d12 req-faad0fea-9135-4a3f-9910-c385d2114ff0 service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Received event network-vif-unplugged-8b08cafe-7e41-42b8-8292-62a1396074f3 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlbIPCZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '26462653063656337', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462653063656337', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.objects.instance [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lazy-loading 'flavor' on Instance uuid 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:26:22 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:22 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:26:22 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:26:22 user nova-compute[73627]:   <serial>365bf35b-01fb-4832-878d-497455702967</serial>
Aug 26 16:26:22 user nova-compute[73627]: </disk>
Aug 26 16:26:22 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:26:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:26:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] No BDM found with device name hda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:26:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] No VIF found with MAC fa:16:3e:2f:bb:ce, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:26:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-86adf009-e86f-4f33-804b-d7ec57132e33 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.999s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:23 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:26:23 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Took 1.05 seconds to deallocate network for instance.
Aug 26 16:26:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067169.1268153, f34a8233-5a54-4a28-b57f-096e8526e80e => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:26:24 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] VM Stopped (Lifecycle Event)
Aug 26 16:26:24 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Deleted allocations for instance 95c10a06-6846-4106-9c43-37054de6bf94
Aug 26 16:26:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-26a19731-fca1-41ff-93f2-8638876ff61a None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7b8a145e-9b46-466e-be51-143a85755591 tempest-VolumesActionsTest-1463312229 tempest-VolumesActionsTest-1463312229-project-member] Lock "95c10a06-6846-4106-9c43-37054de6bf94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:24 user nova-compute[73627]: INFO nova.compute.manager [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Detaching volume 365bf35b-01fb-4832-878d-497455702967
Aug 26 16:26:24 user nova-compute[73627]: INFO nova.virt.block_device [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Attempting to driver detach volume 365bf35b-01fb-4832-878d-497455702967 from mountpoint /dev/vdb
Aug 26 16:26:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Attempting to detach device vdb from instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:26:24 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:24 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:26:24 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:26:24 user nova-compute[73627]:   <serial>365bf35b-01fb-4832-878d-497455702967</serial>
Aug 26 16:26:24 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 16:26:24 user nova-compute[73627]: </disk>
Aug 26 16:26:24 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:26:24 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Successfully detached device vdb from instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 from the persistent domain config.
Aug 26 16:26:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:26:24 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:24 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:26:24 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:26:24 user nova-compute[73627]:   <serial>365bf35b-01fb-4832-878d-497455702967</serial>
Aug 26 16:26:24 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 16:26:24 user nova-compute[73627]: </disk>
Aug 26 16:26:24 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-3acc65f9-2617-488d-9fd5-6990504686dd req-637f9828-e3a1-4b80-91a9-8434e6597b13 service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Received event network-vif-plugged-8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3acc65f9-2617-488d-9fd5-6990504686dd req-637f9828-e3a1-4b80-91a9-8434e6597b13 service nova] Acquiring lock "95c10a06-6846-4106-9c43-37054de6bf94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3acc65f9-2617-488d-9fd5-6990504686dd req-637f9828-e3a1-4b80-91a9-8434e6597b13 service nova] Lock "95c10a06-6846-4106-9c43-37054de6bf94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3acc65f9-2617-488d-9fd5-6990504686dd req-637f9828-e3a1-4b80-91a9-8434e6597b13 service nova] Lock "95c10a06-6846-4106-9c43-37054de6bf94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-3acc65f9-2617-488d-9fd5-6990504686dd req-637f9828-e3a1-4b80-91a9-8434e6597b13 service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] No waiting events found dispatching network-vif-plugged-8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:24 user nova-compute[73627]: WARNING nova.compute.manager [req-3acc65f9-2617-488d-9fd5-6990504686dd req-637f9828-e3a1-4b80-91a9-8434e6597b13 service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Received unexpected event network-vif-plugged-8b08cafe-7e41-42b8-8292-62a1396074f3 for instance with vm_state deleted and task_state None.
Aug 26 16:26:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-3acc65f9-2617-488d-9fd5-6990504686dd req-637f9828-e3a1-4b80-91a9-8434e6597b13 service nova] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Received event network-vif-deleted-8b08cafe-7e41-42b8-8292-62a1396074f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067185.039993, 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:26:25 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Successfully detached device vdb from instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 from the live domain config.
Aug 26 16:26:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlbIPCZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:25 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5645483-14f3-4ff7-9b23-8107fc966578]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fc6ecc-22e4-4c37-9e4e-fcfa28c97acc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3f178cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8dc8d8-0063-4325-bfa2-0cf9e72b9329]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53fe08c-8a03-47c1-a9e3-f16a49424475]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb79098-d2a0-4026-b62b-d2590535a732]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ad93d7-5799-404a-965c-3778c8039b45]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd78088-07b6-42bb-8636-b3a18943e491]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e88dcf6-9187-4e35-86c1-d3d251b8af60]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967, portal: 172.16.0.220,3260]
Aug 26 16:26:25 user nova-compute[73627]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967, portal: 172.16.0.220,3260] successful.
Aug 26 16:26:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365bf35b-01fb-4832-878d-497455702967 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e121c53-e3e7-46ba-bd29-5ba8bf2b9333]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] <== disconnect_volume: return (327ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:26:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.objects.instance [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lazy-loading 'flavor' on Instance uuid 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-37480f14-899f-4629-88a0-a021a3f9261f tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.848s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "interface-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-efb9a29e-9e9c-4c16-8e3f-20adbb774778" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "interface-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-efb9a29e-9e9c-4c16-8e3f-20adbb774778" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.objects.instance [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lazy-loading 'flavor' on Instance uuid 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463194229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463194229',id=8,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Sj6yy35YwIDlvvvihzQymqFhoon7RMyC7OSNPYjzgUeKCKw+OuVT0CMoXlNszZUBa6Mj8sVK/09WRxOxBs8UryT21dkwjmnJCwl3Lu9BmupDqwjouXifLfMdb3Sz8bg==',key_name='tempest-keypair-339813193',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5b9b0bdf908482ea1645968ddc1ba73',ramdisk_id='',reservation_id='r-cb6v5hvu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130913096',owner_user_name='tempest-TaggedAttachmentsTest-1130913096-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:24:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d553291cb27f449bb89c46add55e67e3',uuid=7329f0f0-e851-4a58-92b6-4edc3f9ec5e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "address": "fa:16:3e:15:dc:0f", "network": {"id": "6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-808001052", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9a29e-9e", "ovs_interfaceid": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converting VIF {"id": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "address": "fa:16:3e:15:dc:0f", "network": {"id": "6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-808001052", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9a29e-9e", "ovs_interfaceid": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:0f,bridge_name='br-int',has_traffic_filtering=True,id=efb9a29e-9e9c-4c16-8e3f-20adbb774778,network=Network(6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9a29e-9e') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:dc:0f"/><model type="virtio"/><mtu size="1442"/><target dev="tapefb9a29e-9e"/></interface> {{(pid=73627) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:dc:0f"/><model type="virtio"/><mtu size="1442"/><target dev="tapefb9a29e-9e"/></interface> {{(pid=73627) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Attempting to detach device tapefb9a29e-9e from instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] detach device xml: <interface type="ethernet">
Aug 26 16:26:26 user nova-compute[73627]:   <mac address="fa:16:3e:15:dc:0f"/>
Aug 26 16:26:26 user nova-compute[73627]:   <model type="virtio"/>
Aug 26 16:26:26 user nova-compute[73627]:   <mtu size="1442"/>
Aug 26 16:26:26 user nova-compute[73627]:   <target dev="tapefb9a29e-9e"/>
Aug 26 16:26:26 user nova-compute[73627]: </interface>
Aug 26 16:26:26 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:dc:0f"/><model type="virtio"/><mtu size="1442"/><target dev="tapefb9a29e-9e"/></interface> {{(pid=73627) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:15:dc:0f"/><model type="virtio"/><mtu size="1442"/><target dev="tapefb9a29e-9e"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 26 16:26:26 user nova-compute[73627]:   <name>instance-00000008</name>
Aug 26 16:26:26 user nova-compute[73627]:   <uuid>7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</uuid>
Aug 26 16:26:26 user nova-compute[73627]:   <metadata>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:26:26 user nova-compute[73627]:   <nova:package version="0.0.0"/>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:name>tempest-device-tagging-server-1463194229</nova:name>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:creationTime>2023-08-26 16:25:50</nova:creationTime>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:flavor name="m1.tiny">
Aug 26 16:26:26 user nova-compute[73627]:     <nova:memory>512</nova:memory>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:disk>1</nova:disk>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:swap>0</nova:swap>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:vcpus>1</nova:vcpus>
Aug 26 16:26:26 user nova-compute[73627]:   </nova:flavor>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:owner>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:user uuid="d553291cb27f449bb89c46add55e67e3">tempest-TaggedAttachmentsTest-1130913096-project-member</nova:user>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:project uuid="f5b9b0bdf908482ea1645968ddc1ba73">tempest-TaggedAttachmentsTest-1130913096</nova:project>
Aug 26 16:26:26 user nova-compute[73627]:   </nova:owner>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:ports>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:port uuid="a75b9117-9045-4d5f-8b40-028c8f498bb9">
Aug 26 16:26:26 user nova-compute[73627]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 16:26:26 user nova-compute[73627]:     </nova:port>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:port uuid="efb9a29e-9e9c-4c16-8e3f-20adbb774778">
Aug 26 16:26:26 user nova-compute[73627]:       <nova:ip type="fixed" address="10.10.10.169" ipVersion="4"/>
Aug 26 16:26:26 user nova-compute[73627]:     </nova:port>
Aug 26 16:26:26 user nova-compute[73627]:   </nova:ports>
Aug 26 16:26:26 user nova-compute[73627]: </nova:instance>
Aug 26 16:26:26 user nova-compute[73627]:   </metadata>
Aug 26 16:26:26 user nova-compute[73627]:   <memory unit='KiB'>524288</memory>
Aug 26 16:26:26 user nova-compute[73627]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 16:26:26 user nova-compute[73627]:   <vcpu placement='static'>1</vcpu>
Aug 26 16:26:26 user nova-compute[73627]:   <resource>
Aug 26 16:26:26 user nova-compute[73627]:     <partition>/machine</partition>
Aug 26 16:26:26 user nova-compute[73627]:   </resource>
Aug 26 16:26:26 user nova-compute[73627]:   <sysinfo type='smbios'>
Aug 26 16:26:26 user nova-compute[73627]:     <system>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='version'>0.0.0</entry>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='serial'>7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</entry>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='uuid'>7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</entry>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='family'>Virtual Machine</entry>
Aug 26 16:26:26 user nova-compute[73627]:     </system>
Aug 26 16:26:26 user nova-compute[73627]:   </sysinfo>
Aug 26 16:26:26 user nova-compute[73627]:   <os>
Aug 26 16:26:26 user nova-compute[73627]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 16:26:26 user nova-compute[73627]:     <boot dev='hd'/>
Aug 26 16:26:26 user nova-compute[73627]:     <smbios mode='sysinfo'/>
Aug 26 16:26:26 user nova-compute[73627]:   </os>
Aug 26 16:26:26 user nova-compute[73627]:   <features>
Aug 26 16:26:26 user nova-compute[73627]:     <acpi/>
Aug 26 16:26:26 user nova-compute[73627]:     <apic/>
Aug 26 16:26:26 user nova-compute[73627]:     <vmcoreinfo state='on'/>
Aug 26 16:26:26 user nova-compute[73627]:   </features>
Aug 26 16:26:26 user nova-compute[73627]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 16:26:26 user nova-compute[73627]:     <model fallback='forbid'>Nehalem</model>
Aug 26 16:26:26 user nova-compute[73627]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 16:26:26 user nova-compute[73627]:     <feature policy='require' name='vme'/>
Aug 26 16:26:26 user nova-compute[73627]:     <feature policy='require' name='x2apic'/>
Aug 26 16:26:26 user nova-compute[73627]:     <feature policy='require' name='hypervisor'/>
Aug 26 16:26:26 user nova-compute[73627]:   </cpu>
Aug 26 16:26:26 user nova-compute[73627]:   <clock offset='utc'>
Aug 26 16:26:26 user nova-compute[73627]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 16:26:26 user nova-compute[73627]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 16:26:26 user nova-compute[73627]:     <timer name='hpet' present='no'/>
Aug 26 16:26:26 user nova-compute[73627]:   </clock>
Aug 26 16:26:26 user nova-compute[73627]:   <on_poweroff>destroy</on_poweroff>
Aug 26 16:26:26 user nova-compute[73627]:   <on_reboot>restart</on_reboot>
Aug 26 16:26:26 user nova-compute[73627]:   <on_crash>destroy</on_crash>
Aug 26 16:26:26 user nova-compute[73627]:   <devices>
Aug 26 16:26:26 user nova-compute[73627]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 16:26:26 user nova-compute[73627]:     <disk type='file' device='disk'>
Aug 26 16:26:26 user nova-compute[73627]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 16:26:26 user nova-compute[73627]:       <source file='/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk' index='2'/>
Aug 26 16:26:26 user nova-compute[73627]:       <backingStore type='file' index='3'>
Aug 26 16:26:26 user nova-compute[73627]:         <format type='raw'/>
Aug 26 16:26:26 user nova-compute[73627]:         <source file='/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7'/>
Aug 26 16:26:26 user nova-compute[73627]:         <backingStore/>
Aug 26 16:26:26 user nova-compute[73627]:       </backingStore>
Aug 26 16:26:26 user nova-compute[73627]:       <target dev='vda' bus='virtio'/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='virtio-disk0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </disk>
Aug 26 16:26:26 user nova-compute[73627]:     <disk type='file' device='cdrom'>
Aug 26 16:26:26 user nova-compute[73627]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 16:26:26 user nova-compute[73627]:       <source file='/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk.config' index='1'/>
Aug 26 16:26:26 user nova-compute[73627]:       <backingStore/>
Aug 26 16:26:26 user nova-compute[73627]:       <target dev='hda' bus='ide'/>
Aug 26 16:26:26 user nova-compute[73627]:       <readonly/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='ide0-0-0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </disk>
Aug 26 16:26:26 user nova-compute[73627]:     <controller type='usb' index='0' model='none'>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='usb'/>
Aug 26 16:26:26 user nova-compute[73627]:     </controller>
Aug 26 16:26:26 user nova-compute[73627]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='pci.0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </controller>
Aug 26 16:26:26 user nova-compute[73627]:     <controller type='ide' index='0'>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='ide'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 16:26:26 user nova-compute[73627]:     </controller>
Aug 26 16:26:26 user nova-compute[73627]:     <interface type='ethernet'>
Aug 26 16:26:26 user nova-compute[73627]:       <mac address='fa:16:3e:2f:bb:ce'/>
Aug 26 16:26:26 user nova-compute[73627]:       <target dev='tapa75b9117-90'/>
Aug 26 16:26:26 user nova-compute[73627]:       <model type='virtio'/>
Aug 26 16:26:26 user nova-compute[73627]:       <mtu size='1442'/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='net0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </interface>
Aug 26 16:26:26 user nova-compute[73627]:     <interface type='ethernet'>
Aug 26 16:26:26 user nova-compute[73627]:       <mac address='fa:16:3e:15:dc:0f'/>
Aug 26 16:26:26 user nova-compute[73627]:       <target dev='tapefb9a29e-9e'/>
Aug 26 16:26:26 user nova-compute[73627]:       <model type='virtio'/>
Aug 26 16:26:26 user nova-compute[73627]:       <mtu size='1442'/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='net1'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </interface>
Aug 26 16:26:26 user nova-compute[73627]:     <serial type='pty'>
Aug 26 16:26:26 user nova-compute[73627]:       <source path='/dev/pts/7'/>
Aug 26 16:26:26 user nova-compute[73627]:       <log file='/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/console.log' append='off'/>
Aug 26 16:26:26 user nova-compute[73627]:       <target type='isa-serial' port='0'>
Aug 26 16:26:26 user nova-compute[73627]:         <model name='isa-serial'/>
Aug 26 16:26:26 user nova-compute[73627]:       </target>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='serial0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </serial>
Aug 26 16:26:26 user nova-compute[73627]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 16:26:26 user nova-compute[73627]:       <source path='/dev/pts/7'/>
Aug 26 16:26:26 user nova-compute[73627]:       <log file='/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/console.log' append='off'/>
Aug 26 16:26:26 user nova-compute[73627]:       <target type='serial' port='0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='serial0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </console>
Aug 26 16:26:26 user nova-compute[73627]:     <input type='mouse' bus='ps2'>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='input0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </input>
Aug 26 16:26:26 user nova-compute[73627]:     <input type='keyboard' bus='ps2'>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='input1'/>
Aug 26 16:26:26 user nova-compute[73627]:     </input>
Aug 26 16:26:26 user nova-compute[73627]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 16:26:26 user nova-compute[73627]:       <listen type='address' address='0.0.0.0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </graphics>
Aug 26 16:26:26 user nova-compute[73627]:     <audio id='1' type='none'/>
Aug 26 16:26:26 user nova-compute[73627]:     <video>
Aug 26 16:26:26 user nova-compute[73627]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='video0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </video>
Aug 26 16:26:26 user nova-compute[73627]:     <memballoon model='virtio'>
Aug 26 16:26:26 user nova-compute[73627]:       <stats period='10'/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='balloon0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </memballoon>
Aug 26 16:26:26 user nova-compute[73627]:     <rng model='virtio'>
Aug 26 16:26:26 user nova-compute[73627]:       <backend model='random'>/dev/urandom</backend>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='rng0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </rng>
Aug 26 16:26:26 user nova-compute[73627]:   </devices>
Aug 26 16:26:26 user nova-compute[73627]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 16:26:26 user nova-compute[73627]:     <label>libvirt-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</label>
Aug 26 16:26:26 user nova-compute[73627]:     <imagelabel>libvirt-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</imagelabel>
Aug 26 16:26:26 user nova-compute[73627]:   </seclabel>
Aug 26 16:26:26 user nova-compute[73627]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 16:26:26 user nova-compute[73627]:     <label>+64055:+108</label>
Aug 26 16:26:26 user nova-compute[73627]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 16:26:26 user nova-compute[73627]:   </seclabel>
Aug 26 16:26:26 user nova-compute[73627]: </domain>
Aug 26 16:26:26 user nova-compute[73627]:  {{(pid=73627) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 16:26:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Successfully detached device tapefb9a29e-9e from instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 from the persistent domain config.
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] (1/8): Attempting to detach device tapefb9a29e-9e with device alias net1 from instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] detach device xml: <interface type="ethernet">
Aug 26 16:26:26 user nova-compute[73627]:   <mac address="fa:16:3e:15:dc:0f"/>
Aug 26 16:26:26 user nova-compute[73627]:   <model type="virtio"/>
Aug 26 16:26:26 user nova-compute[73627]:   <mtu size="1442"/>
Aug 26 16:26:26 user nova-compute[73627]:   <target dev="tapefb9a29e-9e"/>
Aug 26 16:26:26 user nova-compute[73627]: </interface>
Aug 26 16:26:26 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.volume.cinder [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Update attachment failed for attachment 532fecc3-f4a8-4fc4-8835-63deb3c283b5. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-c04287a2-f6aa-4285-a2e5-46fe9b89e7f0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-c04287a2-f6aa-4285-a2e5-46fe9b89e7f0)
Aug 26 16:26:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-c04287a2-f6aa-4285-a2e5-46fe9b89e7f0)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Traceback (most recent call last):
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     driver_block_device.attach_block_devices(
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     _log_and_attach(device)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     bdm.attach(*attach_args, **attach_kwargs)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/virt/block_device.py", line 852, in attach
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     super(DriverVolBlankBlockDevice, self).attach(
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     ret_val = method(obj, context, *args, **kwargs)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     self._do_attach(context, instance, volume, volume_api,
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     self._volume_attach(context, volume, connector, instance,
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     connection_info = volume_api.attachment_update(
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     res = method(self, ctx, *args, **kwargs)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     with excutils.save_and_reraise_exception():
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     self.force_reraise()
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     raise self.value
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     return method.func(obj, *args, **kwargs)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     resp = self._update('/attachments/%s' % id, body)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     return self.request(url, method, **kwargs)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352]     raise exceptions.from_response(resp, body)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-c04287a2-f6aa-4285-a2e5-46fe9b89e7f0)
Aug 26 16:26:26 user nova-compute[73627]: ERROR nova.compute.manager [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] 
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.compute.claims [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Aborting claim: <nova.compute.claims.Claim object at 0x7fe3e81a07f0> {{(pid=73627) abort /opt/stack/nova/nova/compute/claims.py:84}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067186.7395518, 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Start waiting for the detach event from libvirt for device tapefb9a29e-9e with device alias net1 for instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:dc:0f"/><model type="virtio"/><mtu size="1442"/><target dev="tapefb9a29e-9e"/></interface> {{(pid=73627) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:15:dc:0f"/><model type="virtio"/><mtu size="1442"/><target dev="tapefb9a29e-9e"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 26 16:26:26 user nova-compute[73627]:   <name>instance-00000008</name>
Aug 26 16:26:26 user nova-compute[73627]:   <uuid>7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</uuid>
Aug 26 16:26:26 user nova-compute[73627]:   <metadata>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:26:26 user nova-compute[73627]:   <nova:package version="0.0.0"/>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:name>tempest-device-tagging-server-1463194229</nova:name>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:creationTime>2023-08-26 16:25:50</nova:creationTime>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:flavor name="m1.tiny">
Aug 26 16:26:26 user nova-compute[73627]:     <nova:memory>512</nova:memory>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:disk>1</nova:disk>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:swap>0</nova:swap>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:vcpus>1</nova:vcpus>
Aug 26 16:26:26 user nova-compute[73627]:   </nova:flavor>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:owner>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:user uuid="d553291cb27f449bb89c46add55e67e3">tempest-TaggedAttachmentsTest-1130913096-project-member</nova:user>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:project uuid="f5b9b0bdf908482ea1645968ddc1ba73">tempest-TaggedAttachmentsTest-1130913096</nova:project>
Aug 26 16:26:26 user nova-compute[73627]:   </nova:owner>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:ports>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:port uuid="a75b9117-9045-4d5f-8b40-028c8f498bb9">
Aug 26 16:26:26 user nova-compute[73627]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 16:26:26 user nova-compute[73627]:     </nova:port>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:port uuid="efb9a29e-9e9c-4c16-8e3f-20adbb774778">
Aug 26 16:26:26 user nova-compute[73627]:       <nova:ip type="fixed" address="10.10.10.169" ipVersion="4"/>
Aug 26 16:26:26 user nova-compute[73627]:     </nova:port>
Aug 26 16:26:26 user nova-compute[73627]:   </nova:ports>
Aug 26 16:26:26 user nova-compute[73627]: </nova:instance>
Aug 26 16:26:26 user nova-compute[73627]:   </metadata>
Aug 26 16:26:26 user nova-compute[73627]:   <memory unit='KiB'>524288</memory>
Aug 26 16:26:26 user nova-compute[73627]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 16:26:26 user nova-compute[73627]:   <vcpu placement='static'>1</vcpu>
Aug 26 16:26:26 user nova-compute[73627]:   <resource>
Aug 26 16:26:26 user nova-compute[73627]:     <partition>/machine</partition>
Aug 26 16:26:26 user nova-compute[73627]:   </resource>
Aug 26 16:26:26 user nova-compute[73627]:   <sysinfo type='smbios'>
Aug 26 16:26:26 user nova-compute[73627]:     <system>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='version'>0.0.0</entry>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='serial'>7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</entry>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='uuid'>7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</entry>
Aug 26 16:26:26 user nova-compute[73627]:       <entry name='family'>Virtual Machine</entry>
Aug 26 16:26:26 user nova-compute[73627]:     </system>
Aug 26 16:26:26 user nova-compute[73627]:   </sysinfo>
Aug 26 16:26:26 user nova-compute[73627]:   <os>
Aug 26 16:26:26 user nova-compute[73627]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 16:26:26 user nova-compute[73627]:     <boot dev='hd'/>
Aug 26 16:26:26 user nova-compute[73627]:     <smbios mode='sysinfo'/>
Aug 26 16:26:26 user nova-compute[73627]:   </os>
Aug 26 16:26:26 user nova-compute[73627]:   <features>
Aug 26 16:26:26 user nova-compute[73627]:     <acpi/>
Aug 26 16:26:26 user nova-compute[73627]:     <apic/>
Aug 26 16:26:26 user nova-compute[73627]:     <vmcoreinfo state='on'/>
Aug 26 16:26:26 user nova-compute[73627]:   </features>
Aug 26 16:26:26 user nova-compute[73627]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 16:26:26 user nova-compute[73627]:     <model fallback='forbid'>Nehalem</model>
Aug 26 16:26:26 user nova-compute[73627]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 16:26:26 user nova-compute[73627]:     <feature policy='require' name='vme'/>
Aug 26 16:26:26 user nova-compute[73627]:     <feature policy='require' name='x2apic'/>
Aug 26 16:26:26 user nova-compute[73627]:     <feature policy='require' name='hypervisor'/>
Aug 26 16:26:26 user nova-compute[73627]:   </cpu>
Aug 26 16:26:26 user nova-compute[73627]:   <clock offset='utc'>
Aug 26 16:26:26 user nova-compute[73627]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 16:26:26 user nova-compute[73627]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 16:26:26 user nova-compute[73627]:     <timer name='hpet' present='no'/>
Aug 26 16:26:26 user nova-compute[73627]:   </clock>
Aug 26 16:26:26 user nova-compute[73627]:   <on_poweroff>destroy</on_poweroff>
Aug 26 16:26:26 user nova-compute[73627]:   <on_reboot>restart</on_reboot>
Aug 26 16:26:26 user nova-compute[73627]:   <on_crash>destroy</on_crash>
Aug 26 16:26:26 user nova-compute[73627]:   <devices>
Aug 26 16:26:26 user nova-compute[73627]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 16:26:26 user nova-compute[73627]:     <disk type='file' device='disk'>
Aug 26 16:26:26 user nova-compute[73627]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 16:26:26 user nova-compute[73627]:       <source file='/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk' index='2'/>
Aug 26 16:26:26 user nova-compute[73627]:       <backingStore type='file' index='3'>
Aug 26 16:26:26 user nova-compute[73627]:         <format type='raw'/>
Aug 26 16:26:26 user nova-compute[73627]:         <source file='/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7'/>
Aug 26 16:26:26 user nova-compute[73627]:         <backingStore/>
Aug 26 16:26:26 user nova-compute[73627]:       </backingStore>
Aug 26 16:26:26 user nova-compute[73627]:       <target dev='vda' bus='virtio'/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='virtio-disk0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </disk>
Aug 26 16:26:26 user nova-compute[73627]:     <disk type='file' device='cdrom'>
Aug 26 16:26:26 user nova-compute[73627]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 16:26:26 user nova-compute[73627]:       <source file='/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk.config' index='1'/>
Aug 26 16:26:26 user nova-compute[73627]:       <backingStore/>
Aug 26 16:26:26 user nova-compute[73627]:       <target dev='hda' bus='ide'/>
Aug 26 16:26:26 user nova-compute[73627]:       <readonly/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='ide0-0-0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </disk>
Aug 26 16:26:26 user nova-compute[73627]:     <controller type='usb' index='0' model='none'>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='usb'/>
Aug 26 16:26:26 user nova-compute[73627]:     </controller>
Aug 26 16:26:26 user nova-compute[73627]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='pci.0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </controller>
Aug 26 16:26:26 user nova-compute[73627]:     <controller type='ide' index='0'>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='ide'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 16:26:26 user nova-compute[73627]:     </controller>
Aug 26 16:26:26 user nova-compute[73627]:     <interface type='ethernet'>
Aug 26 16:26:26 user nova-compute[73627]:       <mac address='fa:16:3e:2f:bb:ce'/>
Aug 26 16:26:26 user nova-compute[73627]:       <target dev='tapa75b9117-90'/>
Aug 26 16:26:26 user nova-compute[73627]:       <model type='virtio'/>
Aug 26 16:26:26 user nova-compute[73627]:       <mtu size='1442'/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='net0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </interface>
Aug 26 16:26:26 user nova-compute[73627]:     <serial type='pty'>
Aug 26 16:26:26 user nova-compute[73627]:       <source path='/dev/pts/7'/>
Aug 26 16:26:26 user nova-compute[73627]:       <log file='/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/console.log' append='off'/>
Aug 26 16:26:26 user nova-compute[73627]:       <target type='isa-serial' port='0'>
Aug 26 16:26:26 user nova-compute[73627]:         <model name='isa-serial'/>
Aug 26 16:26:26 user nova-compute[73627]:       </target>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='serial0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </serial>
Aug 26 16:26:26 user nova-compute[73627]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 16:26:26 user nova-compute[73627]:       <source path='/dev/pts/7'/>
Aug 26 16:26:26 user nova-compute[73627]:       <log file='/opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/console.log' append='off'/>
Aug 26 16:26:26 user nova-compute[73627]:       <target type='serial' port='0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='serial0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </console>
Aug 26 16:26:26 user nova-compute[73627]:     <input type='mouse' bus='ps2'>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='input0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </input>
Aug 26 16:26:26 user nova-compute[73627]:     <input type='keyboard' bus='ps2'>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='input1'/>
Aug 26 16:26:26 user nova-compute[73627]:     </input>
Aug 26 16:26:26 user nova-compute[73627]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 16:26:26 user nova-compute[73627]:       <listen type='address' address='0.0.0.0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </graphics>
Aug 26 16:26:26 user nova-compute[73627]:     <audio id='1' type='none'/>
Aug 26 16:26:26 user nova-compute[73627]:     <video>
Aug 26 16:26:26 user nova-compute[73627]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='video0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </video>
Aug 26 16:26:26 user nova-compute[73627]:     <memballoon model='virtio'>
Aug 26 16:26:26 user nova-compute[73627]:       <stats period='10'/>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='balloon0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </memballoon>
Aug 26 16:26:26 user nova-compute[73627]:     <rng model='virtio'>
Aug 26 16:26:26 user nova-compute[73627]:       <backend model='random'>/dev/urandom</backend>
Aug 26 16:26:26 user nova-compute[73627]:       <alias name='rng0'/>
Aug 26 16:26:26 user nova-compute[73627]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 16:26:26 user nova-compute[73627]:     </rng>
Aug 26 16:26:26 user nova-compute[73627]:   </devices>
Aug 26 16:26:26 user nova-compute[73627]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 16:26:26 user nova-compute[73627]:     <label>libvirt-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</label>
Aug 26 16:26:26 user nova-compute[73627]:     <imagelabel>libvirt-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8</imagelabel>
Aug 26 16:26:26 user nova-compute[73627]:   </seclabel>
Aug 26 16:26:26 user nova-compute[73627]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 16:26:26 user nova-compute[73627]:     <label>+64055:+108</label>
Aug 26 16:26:26 user nova-compute[73627]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 16:26:26 user nova-compute[73627]:   </seclabel>
Aug 26 16:26:26 user nova-compute[73627]: </domain>
Aug 26 16:26:26 user nova-compute[73627]:  {{(pid=73627) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 16:26:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Successfully detached device tapefb9a29e-9e from instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 from the live domain config.
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463194229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463194229',id=8,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Sj6yy35YwIDlvvvihzQymqFhoon7RMyC7OSNPYjzgUeKCKw+OuVT0CMoXlNszZUBa6Mj8sVK/09WRxOxBs8UryT21dkwjmnJCwl3Lu9BmupDqwjouXifLfMdb3Sz8bg==',key_name='tempest-keypair-339813193',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5b9b0bdf908482ea1645968ddc1ba73',ramdisk_id='',reservation_id='r-cb6v5hvu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130913096',owner_user_name='tempest-TaggedAttachmentsTest-1130913096-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:24:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d553291cb27f449bb89c46add55e67e3',uuid=7329f0f0-e851-4a58-92b6-4edc3f9ec5e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "address": "fa:16:3e:15:dc:0f", "network": {"id": "6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-808001052", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9a29e-9e", "ovs_interfaceid": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converting VIF {"id": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "address": "fa:16:3e:15:dc:0f", "network": {"id": "6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-808001052", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9a29e-9e", "ovs_interfaceid": "efb9a29e-9e9c-4c16-8e3f-20adbb774778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:0f,bridge_name='br-int',has_traffic_filtering=True,id=efb9a29e-9e9c-4c16-8e3f-20adbb774778,network=Network(6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9a29e-9e') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG os_vif [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:0f,bridge_name='br-int',has_traffic_filtering=True,id=efb9a29e-9e9c-4c16-8e3f-20adbb774778,network=Network(6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9a29e-9e') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefb9a29e-9e, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:26 user nova-compute[73627]: INFO os_vif [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:0f,bridge_name='br-int',has_traffic_filtering=True,id=efb9a29e-9e9c-4c16-8e3f-20adbb774778,network=Network(6b1eef2a-f61f-4fba-aeb6-288cf3b8ea15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9a29e-9e')
Aug 26 16:26:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:26:26 user nova-compute[73627]:   <nova:package version="0.0.0"/>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:name>tempest-device-tagging-server-1463194229</nova:name>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:creationTime>2023-08-26 16:26:26</nova:creationTime>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:flavor name="m1.tiny">
Aug 26 16:26:26 user nova-compute[73627]:     <nova:memory>512</nova:memory>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:disk>1</nova:disk>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:swap>0</nova:swap>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:vcpus>1</nova:vcpus>
Aug 26 16:26:26 user nova-compute[73627]:   </nova:flavor>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:owner>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:user uuid="d553291cb27f449bb89c46add55e67e3">tempest-TaggedAttachmentsTest-1130913096-project-member</nova:user>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:project uuid="f5b9b0bdf908482ea1645968ddc1ba73">tempest-TaggedAttachmentsTest-1130913096</nova:project>
Aug 26 16:26:26 user nova-compute[73627]:   </nova:owner>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:26:26 user nova-compute[73627]:   <nova:ports>
Aug 26 16:26:26 user nova-compute[73627]:     <nova:port uuid="a75b9117-9045-4d5f-8b40-028c8f498bb9">
Aug 26 16:26:26 user nova-compute[73627]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 16:26:26 user nova-compute[73627]:     </nova:port>
Aug 26 16:26:26 user nova-compute[73627]:   </nova:ports>
Aug 26 16:26:26 user nova-compute[73627]: </nova:instance>
Aug 26 16:26:26 user nova-compute[73627]:  {{(pid=73627) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.542s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Build of instance 612978f6-a682-4bd5-935a-53aaa2c1f352 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-c04287a2-f6aa-4285-a2e5-46fe9b89e7f0) {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2644}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.compute.utils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Build of instance 612978f6-a682-4bd5-935a-53aaa2c1f352 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:7ab2e {{(pid=73627) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Aug 26 16:26:27 user nova-compute[73627]: ERROR nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Build of instance 612978f6-a682-4bd5-935a-53aaa2c1f352 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-c04287a2-f6aa-4285-a2e5-46fe9b89e7f0): nova.exception.BuildAbortException: Build of instance 612978f6-a682-4bd5-935a-53aaa2c1f352 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:7ab2e147-c7cc-449e-a93d-f06dcb05707a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-c04287a2-f6aa-4285-a2e5-46fe9b89e7f0)
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Unplugging VIFs for instance {{(pid=73627) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2980}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-573525254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-573525254',id=15,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b8b30c15b8423e90156082111b000f',ramdisk_id='',reservation_id='r-063fgpy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:26:10Z,user_data=None,user_id='f24169ea97724e1288631ea977a068bd',uuid=612978f6-a682-4bd5-935a-53aaa2c1f352,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532ad4a2-862b-4f70-95cb-7e7228616f1a", "address": "fa:16:3e:60:12:60", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ad4a2-86", "ovs_interfaceid": "532ad4a2-862b-4f70-95cb-7e7228616f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converting VIF {"id": "532ad4a2-862b-4f70-95cb-7e7228616f1a", "address": "fa:16:3e:60:12:60", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ad4a2-86", "ovs_interfaceid": "532ad4a2-862b-4f70-95cb-7e7228616f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:12:60,bridge_name='br-int',has_traffic_filtering=True,id=532ad4a2-862b-4f70-95cb-7e7228616f1a,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532ad4a2-86') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG os_vif [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:12:60,bridge_name='br-int',has_traffic_filtering=True,id=532ad4a2-862b-4f70-95cb-7e7228616f1a,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532ad4a2-86') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap532ad4a2-86, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:26:27 user nova-compute[73627]: INFO os_vif [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:12:60,bridge_name='br-int',has_traffic_filtering=True,id=532ad4a2-862b-4f70-95cb-7e7228616f1a,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532ad4a2-86')
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Unplugged VIFs for instance {{(pid=73627) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3016}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-59ab8ec6-10c8-43df-8bc4-d95ebc4e3bca req-9e5f2636-a8a4-402d-a8c8-ad6e94e54e3a service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-vif-unplugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-59ab8ec6-10c8-43df-8bc4-d95ebc4e3bca req-9e5f2636-a8a4-402d-a8c8-ad6e94e54e3a service nova] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-59ab8ec6-10c8-43df-8bc4-d95ebc4e3bca req-9e5f2636-a8a4-402d-a8c8-ad6e94e54e3a service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-59ab8ec6-10c8-43df-8bc4-d95ebc4e3bca req-9e5f2636-a8a4-402d-a8c8-ad6e94e54e3a service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-59ab8ec6-10c8-43df-8bc4-d95ebc4e3bca req-9e5f2636-a8a4-402d-a8c8-ad6e94e54e3a service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] No waiting events found dispatching network-vif-unplugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:27 user nova-compute[73627]: WARNING nova.compute.manager [req-59ab8ec6-10c8-43df-8bc4-d95ebc4e3bca req-9e5f2636-a8a4-402d-a8c8-ad6e94e54e3a service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received unexpected event network-vif-unplugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 for instance with vm_state active and task_state None.
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:26:27 user nova-compute[73627]: INFO nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Took 0.62 seconds to deallocate network for instance.
Aug 26 16:26:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Detaching volume: 7ab2e147-c7cc-449e-a93d-f06dcb05707a {{(pid=73627) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3208}}
Aug 26 16:26:27 user nova-compute[73627]: INFO nova.compute.manager [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Detaching volume 7ab2e147-c7cc-449e-a93d-f06dcb05707a
Aug 26 16:26:28 user nova-compute[73627]: DEBUG nova.objects.instance [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lazy-loading 'flavor' on Instance uuid 19fcf882-d14e-4478-aed6-5e30db7d3e33 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:26:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquired lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:26:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:26:28 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 612978f6-a682-4bd5-935a-53aaa2c1f352] Skipping driver_detach during remote rebuild. {{(pid=73627) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Aug 26 16:26:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fe5a9a28-62b5-4cd1-b786-0094855dc948 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 16.637s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:28 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Deleted allocations for instance 612978f6-a682-4bd5-935a-53aaa2c1f352
Aug 26 16:26:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cee9b4d1-302f-44c2-b4df-51c1398b988f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "612978f6-a682-4bd5-935a-53aaa2c1f352" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.360s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:28 user nova-compute[73627]: INFO nova.network.neutron [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Port efb9a29e-9e9c-4c16-8e3f-20adbb774778 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 26 16:26:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Updating instance_info_cache with network_info: [{"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:26:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Releasing lock "refresh_cache-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:26:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2aecb02d-ea9b-4656-a848-c7619e9a80be tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "interface-7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-efb9a29e-9e9c-4c16-8e3f-20adbb774778" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.300s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-8f8c5552-78b6-48d8-9233-ccb5a96376da req-32fea9f4-913d-4b7e-a751-cad01f38a9fe service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-vif-plugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8f8c5552-78b6-48d8-9233-ccb5a96376da req-32fea9f4-913d-4b7e-a751-cad01f38a9fe service nova] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8f8c5552-78b6-48d8-9233-ccb5a96376da req-32fea9f4-913d-4b7e-a751-cad01f38a9fe service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8f8c5552-78b6-48d8-9233-ccb5a96376da req-32fea9f4-913d-4b7e-a751-cad01f38a9fe service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-8f8c5552-78b6-48d8-9233-ccb5a96376da req-32fea9f4-913d-4b7e-a751-cad01f38a9fe service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] No waiting events found dispatching network-vif-plugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:29 user nova-compute[73627]: WARNING nova.compute.manager [req-8f8c5552-78b6-48d8-9233-ccb5a96376da req-32fea9f4-913d-4b7e-a751-cad01f38a9fe service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received unexpected event network-vif-plugged-efb9a29e-9e9c-4c16-8e3f-20adbb774778 for instance with vm_state active and task_state None.
Aug 26 16:26:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-8f8c5552-78b6-48d8-9233-ccb5a96376da req-32fea9f4-913d-4b7e-a751-cad01f38a9fe service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-vif-deleted-efb9a29e-9e9c-4c16-8e3f-20adbb774778 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:32 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067177.4804072, 401459e7-47f6-466a-847f-01c92022bb56 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:26:32 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 401459e7-47f6-466a-847f-01c92022bb56] VM Stopped (Lifecycle Event)
Aug 26 16:26:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-2bf7c3ae-2a06-424e-bbef-32b194027ba4 None None] [instance: 401459e7-47f6-466a-847f-01c92022bb56] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067182.4505196, 95c10a06-6846-4106-9c43-37054de6bf94 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:26:37 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] VM Stopped (Lifecycle Event)
Aug 26 16:26:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7c0342b4-7cc1-4dee-a855-d8ed24d58da8 None None] [instance: 95c10a06-6846-4106-9c43-37054de6bf94] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG nova.compute.manager [req-1a571445-322c-49a2-88aa-9de1c416e6d1 req-c3dc48aa-de7d-4e8c-aea2-e877310a9818 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event volume-reimaged-d582e6d4-e3f2-4216-8fa6-26ccfbc29578 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1a571445-322c-49a2-88aa-9de1c416e6d1 req-c3dc48aa-de7d-4e8c-aea2-e877310a9818 service nova] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1a571445-322c-49a2-88aa-9de1c416e6d1 req-c3dc48aa-de7d-4e8c-aea2-e877310a9818 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1a571445-322c-49a2-88aa-9de1c416e6d1 req-c3dc48aa-de7d-4e8c-aea2-e877310a9818 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG nova.compute.manager [req-1a571445-322c-49a2-88aa-9de1c416e6d1 req-c3dc48aa-de7d-4e8c-aea2-e877310a9818 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Processing event volume-reimaged-d582e6d4-e3f2-4216-8fa6-26ccfbc29578 {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Instance event wait completed in 24 seconds for volume-reimaged {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:26:37 user nova-compute[73627]: INFO nova.virt.block_device [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Booting with volume d582e6d4-e3f2-4216-8fa6-26ccfbc29578 at /dev/vda
Aug 26 16:26:37 user nova-compute[73627]: DEBUG os_brick.utils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffab3ec5-6e19-47dc-aa58-4ff289b25ebd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0ec5c2-3b18-47a2-881f-9fcf7c639ba4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[015bc6be-f854-430c-b0af-03b7926c014e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e036306-bbf7-4e21-81b2-69ac3ee3ab4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:26:37 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:26:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0a00ae-e231-4da2-ae59-aa24c09cd9b3]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG os_brick.utils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:37 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Updating existing volume attachment record: 96c28fb2-5d56-4739-a0f7-3dd4cc020e7c {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:26:38 user nova-compute[73627]: INFO nova.compute.claims [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Claim successful on node user
Aug 26 16:26:38 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:26:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:26:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG nova.policy [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5067f58846cf44fc9799db04de44d116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ad08232174cb391be66a7d5605d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:26:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Creating image(s)
Aug 26 16:26:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "/opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "/opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "/opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.174s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk 1073741824" returned: 0 in 0.049s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG nova.network.neutron [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Successfully created port: cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Cannot resize image /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Ensure instance console log exists: /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.network.neutron [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Successfully updated port: cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquired lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.network.neutron [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-ab2dbcb7-b314-4947-92a3-970cd9151762 req-51ab46e7-6511-454f-82ef-1968b1506c4f service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-changed-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-ab2dbcb7-b314-4947-92a3-970cd9151762 req-51ab46e7-6511-454f-82ef-1968b1506c4f service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Refreshing instance network info cache due to event network-changed-cfd70b91-61a4-4ad8-9354-412fb74106c1. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ab2dbcb7-b314-4947-92a3-970cd9151762 req-51ab46e7-6511-454f-82ef-1968b1506c4f service nova] Acquiring lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.network.neutron [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.network.neutron [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Updating instance_info_cache with network_info: [{"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Releasing lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance network_info: |[{"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ab2dbcb7-b314-4947-92a3-970cd9151762 req-51ab46e7-6511-454f-82ef-1968b1506c4f service nova] Acquired lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.network.neutron [req-ab2dbcb7-b314-4947-92a3-970cd9151762 req-51ab46e7-6511-454f-82ef-1968b1506c4f service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Refreshing network info cache for port cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Start _get_guest_xml network_info=[{"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:26:40 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:26:40 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1917134968',display_name='tempest-AttachVolumeTestJSON-server-1917134968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1917134968',id=16,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmPyc6b8C0t21vVKkIWZ8TNBX7zHUhspQfWwTTrOQhl3lcjdUwR4/NQ46CDlwG3vnNcoZ8dr3nq8LPGrMhj+EHJbbjv6sYh5dC2wyhw9PPy0yzES0uh+NmbTaehI0g66w==',key_name='tempest-keypair-1635152815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0x3g7upm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=903e3d2f-fd02-4a36-8b02-dba90b33b8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.objects.instance [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'pci_devices' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:26:40 user nova-compute[73627]:   <uuid>903e3d2f-fd02-4a36-8b02-dba90b33b8f3</uuid>
Aug 26 16:26:40 user nova-compute[73627]:   <name>instance-00000010</name>
Aug 26 16:26:40 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:26:40 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:26:40 user nova-compute[73627]:   <metadata>
Aug 26 16:26:40 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:26:40 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:26:40 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeTestJSON-server-1917134968</nova:name>
Aug 26 16:26:40 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:26:40</nova:creationTime>
Aug 26 16:26:40 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:26:40 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:26:40 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:26:40 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:26:40 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:26:40 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:26:40 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:26:40 user nova-compute[73627]:       <nova:owner>
Aug 26 16:26:40 user nova-compute[73627]:         <nova:user uuid="5067f58846cf44fc9799db04de44d116">tempest-AttachVolumeTestJSON-1152498749-project-member</nova:user>
Aug 26 16:26:40 user nova-compute[73627]:         <nova:project uuid="875ad08232174cb391be66a7d5605d8d">tempest-AttachVolumeTestJSON-1152498749</nova:project>
Aug 26 16:26:40 user nova-compute[73627]:       </nova:owner>
Aug 26 16:26:40 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:26:40 user nova-compute[73627]:       <nova:ports>
Aug 26 16:26:40 user nova-compute[73627]:         <nova:port uuid="cfd70b91-61a4-4ad8-9354-412fb74106c1">
Aug 26 16:26:40 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 16:26:40 user nova-compute[73627]:         </nova:port>
Aug 26 16:26:40 user nova-compute[73627]:       </nova:ports>
Aug 26 16:26:40 user nova-compute[73627]:     </nova:instance>
Aug 26 16:26:40 user nova-compute[73627]:   </metadata>
Aug 26 16:26:40 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:26:40 user nova-compute[73627]:     <system>
Aug 26 16:26:40 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:26:40 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:26:40 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:26:40 user nova-compute[73627]:       <entry name="serial">903e3d2f-fd02-4a36-8b02-dba90b33b8f3</entry>
Aug 26 16:26:40 user nova-compute[73627]:       <entry name="uuid">903e3d2f-fd02-4a36-8b02-dba90b33b8f3</entry>
Aug 26 16:26:40 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:26:40 user nova-compute[73627]:     </system>
Aug 26 16:26:40 user nova-compute[73627]:   </sysinfo>
Aug 26 16:26:40 user nova-compute[73627]:   <os>
Aug 26 16:26:40 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:26:40 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:26:40 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:26:40 user nova-compute[73627]:   </os>
Aug 26 16:26:40 user nova-compute[73627]:   <features>
Aug 26 16:26:40 user nova-compute[73627]:     <acpi/>
Aug 26 16:26:40 user nova-compute[73627]:     <apic/>
Aug 26 16:26:40 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:26:40 user nova-compute[73627]:   </features>
Aug 26 16:26:40 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:26:40 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:26:40 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:26:40 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:26:40 user nova-compute[73627]:   </clock>
Aug 26 16:26:40 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:26:40 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:26:40 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:26:40 user nova-compute[73627]:   </cpu>
Aug 26 16:26:40 user nova-compute[73627]:   <devices>
Aug 26 16:26:40 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:26:40 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:26:40 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk"/>
Aug 26 16:26:40 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:26:40 user nova-compute[73627]:     </disk>
Aug 26 16:26:40 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:26:40 user nova-compute[73627]:       <mac address="fa:16:3e:d1:9a:8b"/>
Aug 26 16:26:40 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:26:40 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:26:40 user nova-compute[73627]:       <target dev="tapcfd70b91-61"/>
Aug 26 16:26:40 user nova-compute[73627]:     </interface>
Aug 26 16:26:40 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:26:40 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/console.log" append="off"/>
Aug 26 16:26:40 user nova-compute[73627]:     </serial>
Aug 26 16:26:40 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:26:40 user nova-compute[73627]:     <video>
Aug 26 16:26:40 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:26:40 user nova-compute[73627]:     </video>
Aug 26 16:26:40 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:26:40 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:26:40 user nova-compute[73627]:     </rng>
Aug 26 16:26:40 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:26:40 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:26:40 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:26:40 user nova-compute[73627]:     </memballoon>
Aug 26 16:26:40 user nova-compute[73627]:   </devices>
Aug 26 16:26:40 user nova-compute[73627]: </domain>
Aug 26 16:26:40 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1917134968',display_name='tempest-AttachVolumeTestJSON-server-1917134968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1917134968',id=16,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmPyc6b8C0t21vVKkIWZ8TNBX7zHUhspQfWwTTrOQhl3lcjdUwR4/NQ46CDlwG3vnNcoZ8dr3nq8LPGrMhj+EHJbbjv6sYh5dC2wyhw9PPy0yzES0uh+NmbTaehI0g66w==',key_name='tempest-keypair-1635152815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0x3g7upm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=903e3d2f-fd02-4a36-8b02-dba90b33b8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG os_vif [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfd70b91-61, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfd70b91-61, col_values=(('external_ids', {'iface-id': 'cfd70b91-61a4-4ad8-9354-412fb74106c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:9a:8b', 'vm-uuid': '903e3d2f-fd02-4a36-8b02-dba90b33b8f3'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:40 user nova-compute[73627]: INFO os_vif [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61')
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:26:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No VIF found with MAC fa:16:3e:d1:9a:8b, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:26:41 user nova-compute[73627]: DEBUG nova.network.neutron [req-ab2dbcb7-b314-4947-92a3-970cd9151762 req-51ab46e7-6511-454f-82ef-1968b1506c4f service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Updated VIF entry in instance network info cache for port cfd70b91-61a4-4ad8-9354-412fb74106c1. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:26:41 user nova-compute[73627]: DEBUG nova.network.neutron [req-ab2dbcb7-b314-4947-92a3-970cd9151762 req-51ab46e7-6511-454f-82ef-1968b1506c4f service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Updating instance_info_cache with network_info: [{"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:26:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ab2dbcb7-b314-4947-92a3-970cd9151762 req-51ab46e7-6511-454f-82ef-1968b1506c4f service nova] Releasing lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:26:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-0b52b4e6-a201-4594-bbbc-1c7c4991787f req-dac9a4e3-170b-4f6b-b936-49bb6d3ac243 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0b52b4e6-a201-4594-bbbc-1c7c4991787f req-dac9a4e3-170b-4f6b-b936-49bb6d3ac243 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0b52b4e6-a201-4594-bbbc-1c7c4991787f req-dac9a4e3-170b-4f6b-b936-49bb6d3ac243 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0b52b4e6-a201-4594-bbbc-1c7c4991787f req-dac9a4e3-170b-4f6b-b936-49bb6d3ac243 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-0b52b4e6-a201-4594-bbbc-1c7c4991787f req-dac9a4e3-170b-4f6b-b936-49bb6d3ac243 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:42 user nova-compute[73627]: WARNING nova.compute.manager [req-0b52b4e6-a201-4594-bbbc-1c7c4991787f req-dac9a4e3-170b-4f6b-b936-49bb6d3ac243 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state building and task_state spawning.
Aug 26 16:26:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067204.3407235, 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:26:44 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] VM Resumed (Lifecycle Event)
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.compute.manager [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:26:44 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance spawned successfully.
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:44 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067204.3414826, 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:26:44 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] VM Started (Lifecycle Event)
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:26:44 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:26:44 user nova-compute[73627]: INFO nova.compute.manager [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.compute.manager [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:44 user nova-compute[73627]: INFO nova.compute.manager [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Took 6.28 seconds to build instance.
Aug 26 16:26:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405fd7e9-e116-4545-b309-8f25e9a79b7e tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.406s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-db5203cb-d24d-4853-8dd1-46040e9a4339 req-b46bf450-2999-4d48-9778-090695511de3 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-db5203cb-d24d-4853-8dd1-46040e9a4339 req-b46bf450-2999-4d48-9778-090695511de3 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-db5203cb-d24d-4853-8dd1-46040e9a4339 req-b46bf450-2999-4d48-9778-090695511de3 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-db5203cb-d24d-4853-8dd1-46040e9a4339 req-b46bf450-2999-4d48-9778-090695511de3 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-db5203cb-d24d-4853-8dd1-46040e9a4339 req-b46bf450-2999-4d48-9778-090695511de3 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:44 user nova-compute[73627]: WARNING nova.compute.manager [req-db5203cb-d24d-4853-8dd1-46040e9a4339 req-b46bf450-2999-4d48-9778-090695511de3 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state active and task_state None.
Aug 26 16:26:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:26:49 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Creating image(s)
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Ensure instance console log exists: /opt/stack/data/nova/instances/f34a8233-5a54-4a28-b57f-096e8526e80e/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Start _get_guest_xml network_info=[{"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEWqVeDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f34a8233-5a54-4a28-b57f-096e8526e80e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd582e6d4-e3f2-4216-8fa6-26ccfbc29578', 'serial': 'd582e6d4-e3f2-4216-8fa6-26ccfbc29578'}, 'guest_format': None, 'attachment_id': '96c28fb2-5d56-4739-a0f7-3dd4cc020e7c', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:49 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 16:26:49 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:26:49 user nova-compute[73627]: DEBUG nova.objects.instance [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lazy-loading 'vcpu_model' on Instance uuid f34a8233-5a54-4a28-b57f-096e8526e80e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEWqVeDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:26:50 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:50 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:26:50 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ffc6a1-ef3d-4585-9f85-db1212a58e2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:26:50 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda6e210-2035-4d89-a7a5-1319e7c0d9be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578] added
Aug 26 16:26:50 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fdc98b-a282-418e-95fc-dcd3f327017e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bba1267-98c3-4e30-8988-d666b5d199c9]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEWqVeDd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEWqVeDd" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa8920e-d350-468d-9721-1e2a05ef69a5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MEWqVeDd'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a370edad-dd8c-46b4-a928-6fed10623345]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e423f3db-a59a-487e-92d6-6232164457ba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec03c61e-c25f-4b02-8a4c-a88439ca1f37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260]
Aug 26 16:26:50 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260] successful.
Aug 26 16:26:50 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1581f7c9-2fc0-4c82-82ce-2492d62c0543]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a1b799-f488-4a9e-8dda-086ee6f0b704]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:26:50 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ad6c80-d421-4dfa-aa40-cc5e990fc6da]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEWqVeDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:26:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26662663965393938', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662663965393938', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-305755365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-221217757',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZg30xf6ADFM2OrxzbSgKjl2I1mfRaXR7ksJbPemPRCTfCXrd27g1yT4kPNFBVdl+SB80btIVwzCgShhqlwfrFbHefKSSkDAwBQ1ev0GfUUbSpBCNWTJ8+qVVI2IoozJQ==',key_name='tempest-keypair-661931287',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:24:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1c0c3d55d3c488a978986d609f8bdb9',ramdisk_id='',reservation_id='r-lj2vpcg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-332170589',owner_user_name='tempest-ServerActionsV293TestJSON-332170589-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:26:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063c3d4f532c4a3da674054d3dfeb5de',uuid=f34a8233-5a54-4a28-b57f-096e8526e80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converting VIF {"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:26:51 user nova-compute[73627]:   <uuid>f34a8233-5a54-4a28-b57f-096e8526e80e</uuid>
Aug 26 16:26:51 user nova-compute[73627]:   <name>instance-0000000b</name>
Aug 26 16:26:51 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:26:51 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:26:51 user nova-compute[73627]:   <metadata>
Aug 26 16:26:51 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:26:51 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:26:51 user nova-compute[73627]:       <nova:name>tempest-ServerActionsV293TestJSON-server-305755365</nova:name>
Aug 26 16:26:51 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:26:49</nova:creationTime>
Aug 26 16:26:51 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:26:51 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:26:51 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:26:51 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:26:51 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:26:51 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:26:51 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:26:51 user nova-compute[73627]:       <nova:owner>
Aug 26 16:26:51 user nova-compute[73627]:         <nova:user uuid="063c3d4f532c4a3da674054d3dfeb5de">tempest-ServerActionsV293TestJSON-332170589-project-member</nova:user>
Aug 26 16:26:51 user nova-compute[73627]:         <nova:project uuid="a1c0c3d55d3c488a978986d609f8bdb9">tempest-ServerActionsV293TestJSON-332170589</nova:project>
Aug 26 16:26:51 user nova-compute[73627]:       </nova:owner>
Aug 26 16:26:51 user nova-compute[73627]:       <nova:ports>
Aug 26 16:26:51 user nova-compute[73627]:         <nova:port uuid="8408461f-84dc-4d3c-afa8-c6b8a2b8ab97">
Aug 26 16:26:51 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 16:26:51 user nova-compute[73627]:         </nova:port>
Aug 26 16:26:51 user nova-compute[73627]:       </nova:ports>
Aug 26 16:26:51 user nova-compute[73627]:     </nova:instance>
Aug 26 16:26:51 user nova-compute[73627]:   </metadata>
Aug 26 16:26:51 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:26:51 user nova-compute[73627]:     <system>
Aug 26 16:26:51 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:26:51 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:26:51 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:26:51 user nova-compute[73627]:       <entry name="serial">f34a8233-5a54-4a28-b57f-096e8526e80e</entry>
Aug 26 16:26:51 user nova-compute[73627]:       <entry name="uuid">f34a8233-5a54-4a28-b57f-096e8526e80e</entry>
Aug 26 16:26:51 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:26:51 user nova-compute[73627]:     </system>
Aug 26 16:26:51 user nova-compute[73627]:   </sysinfo>
Aug 26 16:26:51 user nova-compute[73627]:   <os>
Aug 26 16:26:51 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:26:51 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:26:51 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:26:51 user nova-compute[73627]:   </os>
Aug 26 16:26:51 user nova-compute[73627]:   <features>
Aug 26 16:26:51 user nova-compute[73627]:     <acpi/>
Aug 26 16:26:51 user nova-compute[73627]:     <apic/>
Aug 26 16:26:51 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:26:51 user nova-compute[73627]:   </features>
Aug 26 16:26:51 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:26:51 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:26:51 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:26:51 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:26:51 user nova-compute[73627]:   </clock>
Aug 26 16:26:51 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:26:51 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:26:51 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:26:51 user nova-compute[73627]:   </cpu>
Aug 26 16:26:51 user nova-compute[73627]:   <devices>
Aug 26 16:26:51 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:26:51 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:26:51 user nova-compute[73627]:       <source dev="/dev/sdb"/>
Aug 26 16:26:51 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:26:51 user nova-compute[73627]:       <serial>d582e6d4-e3f2-4216-8fa6-26ccfbc29578</serial>
Aug 26 16:26:51 user nova-compute[73627]:     </disk>
Aug 26 16:26:51 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:26:51 user nova-compute[73627]:       <mac address="fa:16:3e:7b:15:82"/>
Aug 26 16:26:51 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:26:51 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:26:51 user nova-compute[73627]:       <target dev="tap8408461f-84"/>
Aug 26 16:26:51 user nova-compute[73627]:     </interface>
Aug 26 16:26:51 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:26:51 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/f34a8233-5a54-4a28-b57f-096e8526e80e/console.log" append="off"/>
Aug 26 16:26:51 user nova-compute[73627]:     </serial>
Aug 26 16:26:51 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:26:51 user nova-compute[73627]:     <video>
Aug 26 16:26:51 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:26:51 user nova-compute[73627]:     </video>
Aug 26 16:26:51 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:26:51 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:26:51 user nova-compute[73627]:     </rng>
Aug 26 16:26:51 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:26:51 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:26:51 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:26:51 user nova-compute[73627]:     </memballoon>
Aug 26 16:26:51 user nova-compute[73627]:   </devices>
Aug 26 16:26:51 user nova-compute[73627]: </domain>
Aug 26 16:26:51 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-305755365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-221217757',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZg30xf6ADFM2OrxzbSgKjl2I1mfRaXR7ksJbPemPRCTfCXrd27g1yT4kPNFBVdl+SB80btIVwzCgShhqlwfrFbHefKSSkDAwBQ1ev0GfUUbSpBCNWTJ8+qVVI2IoozJQ==',key_name='tempest-keypair-661931287',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:24:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1c0c3d55d3c488a978986d609f8bdb9',ramdisk_id='',reservation_id='r-lj2vpcg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-332170589',owner_user_name='tempest-ServerActionsV293TestJSON-332170589-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:26:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063c3d4f532c4a3da674054d3dfeb5de',uuid=f34a8233-5a54-4a28-b57f-096e8526e80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converting VIF {"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG os_vif [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8408461f-84, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8408461f-84, col_values=(('external_ids', {'iface-id': '8408461f-84dc-4d3c-afa8-c6b8a2b8ab97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:15:82', 'vm-uuid': 'f34a8233-5a54-4a28-b57f-096e8526e80e'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:51 user nova-compute[73627]: INFO os_vif [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84')
Aug 26 16:26:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:26:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] No VIF found with MAC fa:16:3e:7b:15:82, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:26:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-0c9c0a8d-181e-4bde-b3f5-7e6a8799dc04 req-a5fe4a2b-b88d-43ff-b6b7-2021c929c808 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0c9c0a8d-181e-4bde-b3f5-7e6a8799dc04 req-a5fe4a2b-b88d-43ff-b6b7-2021c929c808 service nova] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0c9c0a8d-181e-4bde-b3f5-7e6a8799dc04 req-a5fe4a2b-b88d-43ff-b6b7-2021c929c808 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0c9c0a8d-181e-4bde-b3f5-7e6a8799dc04 req-a5fe4a2b-b88d-43ff-b6b7-2021c929c808 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-0c9c0a8d-181e-4bde-b3f5-7e6a8799dc04 req-a5fe4a2b-b88d-43ff-b6b7-2021c929c808 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] No waiting events found dispatching network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:53 user nova-compute[73627]: WARNING nova.compute.manager [req-0c9c0a8d-181e-4bde-b3f5-7e6a8799dc04 req-a5fe4a2b-b88d-43ff-b6b7-2021c929c808 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received unexpected event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 16:26:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067214.890407, f34a8233-5a54-4a28-b57f-096e8526e80e => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:26:54 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] VM Resumed (Lifecycle Event)
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:26:54 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Instance spawned successfully.
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:26:54 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067214.8914466, f34a8233-5a54-4a28-b57f-096e8526e80e => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:26:54 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] VM Started (Lifecycle Event)
Aug 26 16:26:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:26:54 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 16:26:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:26:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:55 user nova-compute[73627]: DEBUG nova.objects.instance [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73627) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 16:26:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-d56fd4f8-b987-4ec1-8260-e5fb1cf49714 req-8affb3f6-68dd-49ec-84dc-5838131eb0d6 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:26:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d56fd4f8-b987-4ec1-8260-e5fb1cf49714 req-8affb3f6-68dd-49ec-84dc-5838131eb0d6 service nova] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:26:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d56fd4f8-b987-4ec1-8260-e5fb1cf49714 req-8affb3f6-68dd-49ec-84dc-5838131eb0d6 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:26:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d56fd4f8-b987-4ec1-8260-e5fb1cf49714 req-8affb3f6-68dd-49ec-84dc-5838131eb0d6 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-d56fd4f8-b987-4ec1-8260-e5fb1cf49714 req-8affb3f6-68dd-49ec-84dc-5838131eb0d6 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] No waiting events found dispatching network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:26:55 user nova-compute[73627]: WARNING nova.compute.manager [req-d56fd4f8-b987-4ec1-8260-e5fb1cf49714 req-8affb3f6-68dd-49ec-84dc-5838131eb0d6 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received unexpected event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 for instance with vm_state active and task_state None.
Aug 26 16:26:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1a571445-322c-49a2-88aa-9de1c416e6d1 tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.077s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:26:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:26:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:27:00 user nova-compute[73627]: INFO nova.compute.claims [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Claim successful on node user
Aug 26 16:27:00 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.155s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:27:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:27:00 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:27:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.policy [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f24169ea97724e1288631ea977a068bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b8b30c15b8423e90156082111b000f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:27:01 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Creating image(s)
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "/opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "/opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "/opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk 1073741824" returned: 0 in 0.048s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Cannot resize image /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Ensure instance console log exists: /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Successfully created port: 59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:27:04 user nova-compute[73627]: INFO nova.compute.claims [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Claim successful on node user
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Successfully updated port: 59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "refresh_cache-a20c0a68-9781-4d6c-8f55-6952f1758f1f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquired lock "refresh_cache-a20c0a68-9781-4d6c-8f55-6952f1758f1f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-b6c43aed-2eef-466c-9bfb-718cf8171ccb req-832683fa-5994-4877-b720-ac50f5617b11 service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Received event network-changed-59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-b6c43aed-2eef-466c-9bfb-718cf8171ccb req-832683fa-5994-4877-b720-ac50f5617b11 service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Refreshing instance network info cache due to event network-changed-59d678db-6b22-4bb3-a3a1-d8661d59e588. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6c43aed-2eef-466c-9bfb-718cf8171ccb req-832683fa-5994-4877-b720-ac50f5617b11 service nova] Acquiring lock "refresh_cache-a20c0a68-9781-4d6c-8f55-6952f1758f1f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Updating instance_info_cache with network_info: [{"id": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "address": "fa:16:3e:fa:cd:15", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d678db-6b", "ovs_interfaceid": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Releasing lock "refresh_cache-a20c0a68-9781-4d6c-8f55-6952f1758f1f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Instance network_info: |[{"id": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "address": "fa:16:3e:fa:cd:15", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d678db-6b", "ovs_interfaceid": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6c43aed-2eef-466c-9bfb-718cf8171ccb req-832683fa-5994-4877-b720-ac50f5617b11 service nova] Acquired lock "refresh_cache-a20c0a68-9781-4d6c-8f55-6952f1758f1f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-b6c43aed-2eef-466c-9bfb-718cf8171ccb req-832683fa-5994-4877-b720-ac50f5617b11 service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Refreshing network info cache for port 59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Start _get_guest_xml network_info=[{"id": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "address": "fa:16:3e:fa:cd:15", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d678db-6b", "ovs_interfaceid": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:27:04 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:27:04 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-76647444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-76647444',id=17,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b8b30c15b8423e90156082111b000f',ramdisk_id='',reservation_id='r-sj6kr4d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:27:01Z,user_data=None,user_id='f24169ea97724e1288631ea977a068bd',uuid=a20c0a68-9781-4d6c-8f55-6952f1758f1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "address": "fa:16:3e:fa:cd:15", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d678db-6b", "ovs_interfaceid": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converting VIF {"id": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "address": "fa:16:3e:fa:cd:15", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d678db-6b", "ovs_interfaceid": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=59d678db-6b22-4bb3-a3a1-d8661d59e588,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d678db-6b') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.objects.instance [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'pci_devices' on Instance uuid a20c0a68-9781-4d6c-8f55-6952f1758f1f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:27:04 user nova-compute[73627]:   <uuid>a20c0a68-9781-4d6c-8f55-6952f1758f1f</uuid>
Aug 26 16:27:04 user nova-compute[73627]:   <name>instance-00000011</name>
Aug 26 16:27:04 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:27:04 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:27:04 user nova-compute[73627]:   <metadata>
Aug 26 16:27:04 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:27:04 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:27:04 user nova-compute[73627]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-76647444</nova:name>
Aug 26 16:27:04 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:27:04</nova:creationTime>
Aug 26 16:27:04 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:27:04 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:27:04 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:27:04 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:27:04 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:27:04 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:27:04 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:27:04 user nova-compute[73627]:       <nova:owner>
Aug 26 16:27:04 user nova-compute[73627]:         <nova:user uuid="f24169ea97724e1288631ea977a068bd">tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member</nova:user>
Aug 26 16:27:04 user nova-compute[73627]:         <nova:project uuid="c8b8b30c15b8423e90156082111b000f">tempest-ServerBootFromVolumeStableRescueTest-2135030864</nova:project>
Aug 26 16:27:04 user nova-compute[73627]:       </nova:owner>
Aug 26 16:27:04 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:27:04 user nova-compute[73627]:       <nova:ports>
Aug 26 16:27:04 user nova-compute[73627]:         <nova:port uuid="59d678db-6b22-4bb3-a3a1-d8661d59e588">
Aug 26 16:27:04 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 16:27:04 user nova-compute[73627]:         </nova:port>
Aug 26 16:27:04 user nova-compute[73627]:       </nova:ports>
Aug 26 16:27:04 user nova-compute[73627]:     </nova:instance>
Aug 26 16:27:04 user nova-compute[73627]:   </metadata>
Aug 26 16:27:04 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:27:04 user nova-compute[73627]:     <system>
Aug 26 16:27:04 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:27:04 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:27:04 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:27:04 user nova-compute[73627]:       <entry name="serial">a20c0a68-9781-4d6c-8f55-6952f1758f1f</entry>
Aug 26 16:27:04 user nova-compute[73627]:       <entry name="uuid">a20c0a68-9781-4d6c-8f55-6952f1758f1f</entry>
Aug 26 16:27:04 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:27:04 user nova-compute[73627]:     </system>
Aug 26 16:27:04 user nova-compute[73627]:   </sysinfo>
Aug 26 16:27:04 user nova-compute[73627]:   <os>
Aug 26 16:27:04 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:27:04 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:27:04 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:27:04 user nova-compute[73627]:   </os>
Aug 26 16:27:04 user nova-compute[73627]:   <features>
Aug 26 16:27:04 user nova-compute[73627]:     <acpi/>
Aug 26 16:27:04 user nova-compute[73627]:     <apic/>
Aug 26 16:27:04 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:27:04 user nova-compute[73627]:   </features>
Aug 26 16:27:04 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:27:04 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:27:04 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:27:04 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:27:04 user nova-compute[73627]:   </clock>
Aug 26 16:27:04 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:27:04 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:27:04 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:27:04 user nova-compute[73627]:   </cpu>
Aug 26 16:27:04 user nova-compute[73627]:   <devices>
Aug 26 16:27:04 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:27:04 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:27:04 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk"/>
Aug 26 16:27:04 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:27:04 user nova-compute[73627]:     </disk>
Aug 26 16:27:04 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:27:04 user nova-compute[73627]:       <mac address="fa:16:3e:fa:cd:15"/>
Aug 26 16:27:04 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:27:04 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:27:04 user nova-compute[73627]:       <target dev="tap59d678db-6b"/>
Aug 26 16:27:04 user nova-compute[73627]:     </interface>
Aug 26 16:27:04 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:27:04 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/console.log" append="off"/>
Aug 26 16:27:04 user nova-compute[73627]:     </serial>
Aug 26 16:27:04 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:27:04 user nova-compute[73627]:     <video>
Aug 26 16:27:04 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:27:04 user nova-compute[73627]:     </video>
Aug 26 16:27:04 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:27:04 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:27:04 user nova-compute[73627]:     </rng>
Aug 26 16:27:04 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:27:04 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:27:04 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:27:04 user nova-compute[73627]:     </memballoon>
Aug 26 16:27:04 user nova-compute[73627]:   </devices>
Aug 26 16:27:04 user nova-compute[73627]: </domain>
Aug 26 16:27:04 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-76647444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-76647444',id=17,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b8b30c15b8423e90156082111b000f',ramdisk_id='',reservation_id='r-sj6kr4d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:27:01Z,user_data=None,user_id='f24169ea97724e1288631ea977a068bd',uuid=a20c0a68-9781-4d6c-8f55-6952f1758f1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "address": "fa:16:3e:fa:cd:15", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d678db-6b", "ovs_interfaceid": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converting VIF {"id": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "address": "fa:16:3e:fa:cd:15", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d678db-6b", "ovs_interfaceid": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=59d678db-6b22-4bb3-a3a1-d8661d59e588,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d678db-6b') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG os_vif [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=59d678db-6b22-4bb3-a3a1-d8661d59e588,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d678db-6b') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59d678db-6b, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59d678db-6b, col_values=(('external_ids', {'iface-id': '59d678db-6b22-4bb3-a3a1-d8661d59e588', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:cd:15', 'vm-uuid': 'a20c0a68-9781-4d6c-8f55-6952f1758f1f'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:27:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:04 user nova-compute[73627]: INFO os_vif [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=59d678db-6b22-4bb3-a3a1-d8661d59e588,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d678db-6b')
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.948s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] No VIF found with MAC fa:16:3e:fa:cd:15, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.network.neutron [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.policy [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46cb037a25de4d47b21fe34498409ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db772b720283431e97eb7ccbd346884d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:27:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Creating image(s)
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "/opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "/opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "/opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-b6c43aed-2eef-466c-9bfb-718cf8171ccb req-832683fa-5994-4877-b720-ac50f5617b11 service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Updated VIF entry in instance network info cache for port 59d678db-6b22-4bb3-a3a1-d8661d59e588. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-b6c43aed-2eef-466c-9bfb-718cf8171ccb req-832683fa-5994-4877-b720-ac50f5617b11 service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Updating instance_info_cache with network_info: [{"id": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "address": "fa:16:3e:fa:cd:15", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d678db-6b", "ovs_interfaceid": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6c43aed-2eef-466c-9bfb-718cf8171ccb req-832683fa-5994-4877-b720-ac50f5617b11 service nova] Releasing lock "refresh_cache-a20c0a68-9781-4d6c-8f55-6952f1758f1f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.208s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.network.neutron [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Successfully created port: 8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067228.9467154, a20c0a68-9781-4d6c-8f55-6952f1758f1f => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:27:09 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] VM Resumed (Lifecycle Event)
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-11c24477-e5c9-4297-81bf-4467fe6a0212 req-245701c8-d800-4bf8-ae42-f70aeab83d05 service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Received event network-vif-plugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-11c24477-e5c9-4297-81bf-4467fe6a0212 req-245701c8-d800-4bf8-ae42-f70aeab83d05 service nova] Acquiring lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-11c24477-e5c9-4297-81bf-4467fe6a0212 req-245701c8-d800-4bf8-ae42-f70aeab83d05 service nova] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-11c24477-e5c9-4297-81bf-4467fe6a0212 req-245701c8-d800-4bf8-ae42-f70aeab83d05 service nova] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-11c24477-e5c9-4297-81bf-4467fe6a0212 req-245701c8-d800-4bf8-ae42-f70aeab83d05 service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] No waiting events found dispatching network-vif-plugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:09 user nova-compute[73627]: WARNING nova.compute.manager [req-11c24477-e5c9-4297-81bf-4467fe6a0212 req-245701c8-d800-4bf8-ae42-f70aeab83d05 service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Received unexpected event network-vif-plugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 for instance with vm_state building and task_state spawning.
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-6532db09-397d-4f3d-9f9d-d62cb99d099f req-021d02bd-0ed3-4d14-93a3-ebe0d03c495f service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Received event network-vif-plugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6532db09-397d-4f3d-9f9d-d62cb99d099f req-021d02bd-0ed3-4d14-93a3-ebe0d03c495f service nova] Acquiring lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6532db09-397d-4f3d-9f9d-d62cb99d099f req-021d02bd-0ed3-4d14-93a3-ebe0d03c495f service nova] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6532db09-397d-4f3d-9f9d-d62cb99d099f req-021d02bd-0ed3-4d14-93a3-ebe0d03c495f service nova] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-6532db09-397d-4f3d-9f9d-d62cb99d099f req-021d02bd-0ed3-4d14-93a3-ebe0d03c495f service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] No waiting events found dispatching network-vif-plugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:09 user nova-compute[73627]: WARNING nova.compute.manager [req-6532db09-397d-4f3d-9f9d-d62cb99d099f req-021d02bd-0ed3-4d14-93a3-ebe0d03c495f service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Received unexpected event network-vif-plugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 for instance with vm_state building and task_state spawning.
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 3.881s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Instance spawned successfully.
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Acquiring lock "3b4253a4-1436-4026-8549-f48f1bb8f121" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Acquiring lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk 1073741824" returned: 0 in 0.076s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:27:09 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:27:09 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=6951MB free_disk=25.581512451171875GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 3.971s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:09 user nova-compute[73627]: INFO nova.compute.manager [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Terminating instance
Aug 26 16:27:09 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067228.9495814, a20c0a68-9781-4d6c-8f55-6952f1758f1f => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:27:09 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] VM Started (Lifecycle Event)
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:27:09 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:27:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:09 user nova-compute[73627]: INFO nova.compute.manager [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Took 8.64 seconds to spawn the instance on the hypervisor.
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.222s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 3b4253a4-1436-4026-8549-f48f1bb8f121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f34a8233-5a54-4a28-b57f-096e8526e80e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f961b797-16bd-43bd-8735-93578f1084cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a20c0a68-9781-4d6c-8f55-6952f1758f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de2d5475-ec56-47dc-aa29-8a3ff80e3f0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:27:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Cannot resize image /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Ensure instance console log exists: /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:10 user nova-compute[73627]: INFO nova.compute.manager [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Took 9.72 seconds to build instance.
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-5dcd98ef-3a41-4674-8268-81a2a3c3455a req-cb1df9bb-dd7c-4618-ae79-410101310dee service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Received event network-vif-unplugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5dcd98ef-3a41-4674-8268-81a2a3c3455a req-cb1df9bb-dd7c-4618-ae79-410101310dee service nova] Acquiring lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5dcd98ef-3a41-4674-8268-81a2a3c3455a req-cb1df9bb-dd7c-4618-ae79-410101310dee service nova] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5dcd98ef-3a41-4674-8268-81a2a3c3455a req-cb1df9bb-dd7c-4618-ae79-410101310dee service nova] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-5dcd98ef-3a41-4674-8268-81a2a3c3455a req-cb1df9bb-dd7c-4618-ae79-410101310dee service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] No waiting events found dispatching network-vif-unplugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-5dcd98ef-3a41-4674-8268-81a2a3c3455a req-cb1df9bb-dd7c-4618-ae79-410101310dee service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Received event network-vif-unplugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f27be839-ef37-456a-a9cc-a4959c01c320 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.830s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:10 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Instance destroyed successfully.
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lazy-loading 'resources' on Instance uuid 3b4253a4-1436-4026-8549-f48f1bb8f121 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-804320675',display_name='tempest-VolumesAssistedSnapshotsTest-server-804320675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-804320675',id=9,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHW3a4Us1ze8WEZmy7vfawXegcIItK7ctfqRgQdCBgyuRPdR6i5OgJjQ1Trm5l/qw4o2AvA+47w1SxvBlPV3nlJKesM9hpuDuB1HCjtZStw5KNtY89KyyNPKA3ngN9MBUA==',key_name='tempest-keypair-230304301',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46ed90cd886d40f5bf932825592a5be0',ramdisk_id='',reservation_id='r-lmjel2ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1099430394',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1099430394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0f5d943da2c46799cd588eee9410ebb',uuid=3b4253a4-1436-4026-8549-f48f1bb8f121,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "address": "fa:16:3e:7c:c9:53", "network": {"id": "c283b31b-dc07-4174-8354-d08d62d93df9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-305034803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ed90cd886d40f5bf932825592a5be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c01107b-5d", "ovs_interfaceid": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Converting VIF {"id": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "address": "fa:16:3e:7c:c9:53", "network": {"id": "c283b31b-dc07-4174-8354-d08d62d93df9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-305034803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ed90cd886d40f5bf932825592a5be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c01107b-5d", "ovs_interfaceid": "7c01107b-5db8-4c30-b7eb-179c1cfdadc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:c9:53,bridge_name='br-int',has_traffic_filtering=True,id=7c01107b-5db8-4c30-b7eb-179c1cfdadc1,network=Network(c283b31b-dc07-4174-8354-d08d62d93df9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c01107b-5d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG os_vif [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:c9:53,bridge_name='br-int',has_traffic_filtering=True,id=7c01107b-5db8-4c30-b7eb-179c1cfdadc1,network=Network(c283b31b-dc07-4174-8354-d08d62d93df9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c01107b-5d') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c01107b-5d, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:10 user nova-compute[73627]: INFO os_vif [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:c9:53,bridge_name='br-int',has_traffic_filtering=True,id=7c01107b-5db8-4c30-b7eb-179c1cfdadc1,network=Network(c283b31b-dc07-4174-8354-d08d62d93df9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c01107b-5d')
Aug 26 16:27:10 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Deleting instance files /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121_del
Aug 26 16:27:10 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Deletion of /opt/stack/data/nova/instances/3b4253a4-1436-4026-8549-f48f1bb8f121_del complete
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.997s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:10 user nova-compute[73627]: INFO nova.compute.manager [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Successfully updated port: 8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "refresh_cache-de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquired lock "refresh_cache-de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-440e2b4b-96a6-457d-a52a-4b2aaaa0e0cb req-988ac4d1-92c7-489d-a06b-2c0e276b8c27 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Received event network-changed-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-440e2b4b-96a6-457d-a52a-4b2aaaa0e0cb req-988ac4d1-92c7-489d-a06b-2c0e276b8c27 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Refreshing instance network info cache due to event network-changed-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-440e2b4b-96a6-457d-a52a-4b2aaaa0e0cb req-988ac4d1-92c7-489d-a06b-2c0e276b8c27 service nova] Acquiring lock "refresh_cache-de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:27:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Updating instance_info_cache with network_info: [{"id": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "address": "fa:16:3e:10:64:0b", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdaadc9-aa", "ovs_interfaceid": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Releasing lock "refresh_cache-de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Instance network_info: |[{"id": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "address": "fa:16:3e:10:64:0b", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdaadc9-aa", "ovs_interfaceid": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-440e2b4b-96a6-457d-a52a-4b2aaaa0e0cb req-988ac4d1-92c7-489d-a06b-2c0e276b8c27 service nova] Acquired lock "refresh_cache-de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.network.neutron [req-440e2b4b-96a6-457d-a52a-4b2aaaa0e0cb req-988ac4d1-92c7-489d-a06b-2c0e276b8c27 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Refreshing network info cache for port 8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Start _get_guest_xml network_info=[{"id": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "address": "fa:16:3e:10:64:0b", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdaadc9-aa", "ovs_interfaceid": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:27:11 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:27:11 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-939752640',display_name='tempest-VolumesAdminNegativeTest-server-939752640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-939752640',id=18,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db772b720283431e97eb7ccbd346884d',ramdisk_id='',reservation_id='r-z436ocfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-8811083',owner_user_name='tempest-VolumesAdminNegativeTest-8811083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:27:05Z,user_data=None,user_id='46cb037a25de4d47b21fe34498409ad7',uuid=de2d5475-ec56-47dc-aa29-8a3ff80e3f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "address": "fa:16:3e:10:64:0b", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdaadc9-aa", "ovs_interfaceid": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converting VIF {"id": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "address": "fa:16:3e:10:64:0b", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdaadc9-aa", "ovs_interfaceid": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdaadc9-aa') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.objects.instance [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lazy-loading 'pci_devices' on Instance uuid de2d5475-ec56-47dc-aa29-8a3ff80e3f0d {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:27:11 user nova-compute[73627]:   <uuid>de2d5475-ec56-47dc-aa29-8a3ff80e3f0d</uuid>
Aug 26 16:27:11 user nova-compute[73627]:   <name>instance-00000012</name>
Aug 26 16:27:11 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:27:11 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:27:11 user nova-compute[73627]:   <metadata>
Aug 26 16:27:11 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:27:11 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:27:11 user nova-compute[73627]:       <nova:name>tempest-VolumesAdminNegativeTest-server-939752640</nova:name>
Aug 26 16:27:11 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:27:11</nova:creationTime>
Aug 26 16:27:11 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:27:11 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:27:11 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:27:11 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:27:11 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:27:11 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:27:11 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:27:11 user nova-compute[73627]:       <nova:owner>
Aug 26 16:27:11 user nova-compute[73627]:         <nova:user uuid="46cb037a25de4d47b21fe34498409ad7">tempest-VolumesAdminNegativeTest-8811083-project-member</nova:user>
Aug 26 16:27:11 user nova-compute[73627]:         <nova:project uuid="db772b720283431e97eb7ccbd346884d">tempest-VolumesAdminNegativeTest-8811083</nova:project>
Aug 26 16:27:11 user nova-compute[73627]:       </nova:owner>
Aug 26 16:27:11 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:27:11 user nova-compute[73627]:       <nova:ports>
Aug 26 16:27:11 user nova-compute[73627]:         <nova:port uuid="8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033">
Aug 26 16:27:11 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 16:27:11 user nova-compute[73627]:         </nova:port>
Aug 26 16:27:11 user nova-compute[73627]:       </nova:ports>
Aug 26 16:27:11 user nova-compute[73627]:     </nova:instance>
Aug 26 16:27:11 user nova-compute[73627]:   </metadata>
Aug 26 16:27:11 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:27:11 user nova-compute[73627]:     <system>
Aug 26 16:27:11 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:27:11 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:27:11 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:27:11 user nova-compute[73627]:       <entry name="serial">de2d5475-ec56-47dc-aa29-8a3ff80e3f0d</entry>
Aug 26 16:27:11 user nova-compute[73627]:       <entry name="uuid">de2d5475-ec56-47dc-aa29-8a3ff80e3f0d</entry>
Aug 26 16:27:11 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:27:11 user nova-compute[73627]:     </system>
Aug 26 16:27:11 user nova-compute[73627]:   </sysinfo>
Aug 26 16:27:11 user nova-compute[73627]:   <os>
Aug 26 16:27:11 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:27:11 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:27:11 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:27:11 user nova-compute[73627]:   </os>
Aug 26 16:27:11 user nova-compute[73627]:   <features>
Aug 26 16:27:11 user nova-compute[73627]:     <acpi/>
Aug 26 16:27:11 user nova-compute[73627]:     <apic/>
Aug 26 16:27:11 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:27:11 user nova-compute[73627]:   </features>
Aug 26 16:27:11 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:27:11 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:27:11 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:27:11 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:27:11 user nova-compute[73627]:   </clock>
Aug 26 16:27:11 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:27:11 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:27:11 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:27:11 user nova-compute[73627]:   </cpu>
Aug 26 16:27:11 user nova-compute[73627]:   <devices>
Aug 26 16:27:11 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:27:11 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:27:11 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk"/>
Aug 26 16:27:11 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:27:11 user nova-compute[73627]:     </disk>
Aug 26 16:27:11 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:27:11 user nova-compute[73627]:       <mac address="fa:16:3e:10:64:0b"/>
Aug 26 16:27:11 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:27:11 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:27:11 user nova-compute[73627]:       <target dev="tap8cdaadc9-aa"/>
Aug 26 16:27:11 user nova-compute[73627]:     </interface>
Aug 26 16:27:11 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:27:11 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/console.log" append="off"/>
Aug 26 16:27:11 user nova-compute[73627]:     </serial>
Aug 26 16:27:11 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:27:11 user nova-compute[73627]:     <video>
Aug 26 16:27:11 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:27:11 user nova-compute[73627]:     </video>
Aug 26 16:27:11 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:27:11 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:27:11 user nova-compute[73627]:     </rng>
Aug 26 16:27:11 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:27:11 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:27:11 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:27:11 user nova-compute[73627]:     </memballoon>
Aug 26 16:27:11 user nova-compute[73627]:   </devices>
Aug 26 16:27:11 user nova-compute[73627]: </domain>
Aug 26 16:27:11 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-939752640',display_name='tempest-VolumesAdminNegativeTest-server-939752640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-939752640',id=18,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db772b720283431e97eb7ccbd346884d',ramdisk_id='',reservation_id='r-z436ocfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-8811083',owner_user_name='tempest-VolumesAdminNegativeTest-8811083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:27:05Z,user_data=None,user_id='46cb037a25de4d47b21fe34498409ad7',uuid=de2d5475-ec56-47dc-aa29-8a3ff80e3f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "address": "fa:16:3e:10:64:0b", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdaadc9-aa", "ovs_interfaceid": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converting VIF {"id": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "address": "fa:16:3e:10:64:0b", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdaadc9-aa", "ovs_interfaceid": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdaadc9-aa') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG os_vif [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdaadc9-aa') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cdaadc9-aa, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8cdaadc9-aa, col_values=(('external_ids', {'iface-id': '8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:64:0b', 'vm-uuid': 'de2d5475-ec56-47dc-aa29-8a3ff80e3f0d'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:11 user nova-compute[73627]: INFO os_vif [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdaadc9-aa')
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] No VIF found with MAC fa:16:3e:10:64:0b, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:11 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Took 1.09 seconds to deallocate network for instance.
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-4b0534a8-2bf0-43c4-b89b-4198bf5642a6 req-2dcef52a-0f29-46af-81e9-4ba0501830dd service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Received event network-vif-deleted-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:11 user nova-compute[73627]: INFO nova.compute.manager [req-4b0534a8-2bf0-43c4-b89b-4198bf5642a6 req-2dcef52a-0f29-46af-81e9-4ba0501830dd service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Neutron deleted interface 7c01107b-5db8-4c30-b7eb-179c1cfdadc1; detaching it from the instance and deleting it from the info cache
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.network.neutron [req-4b0534a8-2bf0-43c4-b89b-4198bf5642a6 req-2dcef52a-0f29-46af-81e9-4ba0501830dd service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-4b0534a8-2bf0-43c4-b89b-4198bf5642a6 req-2dcef52a-0f29-46af-81e9-4ba0501830dd service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Detach interface failed, port_id=7c01107b-5db8-4c30-b7eb-179c1cfdadc1, reason: Instance 3b4253a4-1436-4026-8549-f48f1bb8f121 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-8b67d7de-2a6a-4d80-bd72-17e3f4ea77f2 req-cb442461-3f6b-458d-b871-55d7057d4894 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Received event network-vif-plugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8b67d7de-2a6a-4d80-bd72-17e3f4ea77f2 req-cb442461-3f6b-458d-b871-55d7057d4894 service nova] Acquiring lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8b67d7de-2a6a-4d80-bd72-17e3f4ea77f2 req-cb442461-3f6b-458d-b871-55d7057d4894 service nova] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8b67d7de-2a6a-4d80-bd72-17e3f4ea77f2 req-cb442461-3f6b-458d-b871-55d7057d4894 service nova] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-8b67d7de-2a6a-4d80-bd72-17e3f4ea77f2 req-cb442461-3f6b-458d-b871-55d7057d4894 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] No waiting events found dispatching network-vif-plugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:12 user nova-compute[73627]: WARNING nova.compute.manager [req-8b67d7de-2a6a-4d80-bd72-17e3f4ea77f2 req-cb442461-3f6b-458d-b871-55d7057d4894 service nova] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Received unexpected event network-vif-plugged-7c01107b-5db8-4c30-b7eb-179c1cfdadc1 for instance with vm_state deleted and task_state None.
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.590s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:12 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Deleted allocations for instance 3b4253a4-1436-4026-8549-f48f1bb8f121
Aug 26 16:27:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-440e2b4b-96a6-457d-a52a-4b2aaaa0e0cb req-988ac4d1-92c7-489d-a06b-2c0e276b8c27 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Updated VIF entry in instance network info cache for port 8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-440e2b4b-96a6-457d-a52a-4b2aaaa0e0cb req-988ac4d1-92c7-489d-a06b-2c0e276b8c27 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Updating instance_info_cache with network_info: [{"id": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "address": "fa:16:3e:10:64:0b", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdaadc9-aa", "ovs_interfaceid": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-440e2b4b-96a6-457d-a52a-4b2aaaa0e0cb req-988ac4d1-92c7-489d-a06b-2c0e276b8c27 service nova] Releasing lock "refresh_cache-de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7cdfcf63-49cc-46b4-8b38-fd0392c03f74 tempest-VolumesAssistedSnapshotsTest-1099430394 tempest-VolumesAssistedSnapshotsTest-1099430394-project-member] Lock "3b4253a4-1436-4026-8549-f48f1bb8f121" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.983s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Updating instance_info_cache with network_info: [{"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:13 user nova-compute[73627]: DEBUG nova.compute.manager [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Received event network-vif-plugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] Acquiring lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:13 user nova-compute[73627]: DEBUG nova.compute.manager [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] No waiting events found dispatching network-vif-plugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:13 user nova-compute[73627]: WARNING nova.compute.manager [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Received unexpected event network-vif-plugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 for instance with vm_state building and task_state spawning.
Aug 26 16:27:13 user nova-compute[73627]: DEBUG nova.compute.manager [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Received event network-vif-plugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] Acquiring lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:13 user nova-compute[73627]: DEBUG nova.compute.manager [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] No waiting events found dispatching network-vif-plugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:13 user nova-compute[73627]: WARNING nova.compute.manager [req-409de66d-4867-4928-ac8b-598724ec039d req-ecae58f3-c68d-4403-a617-079e306720e1 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Received unexpected event network-vif-plugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 for instance with vm_state building and task_state spawning.
Aug 26 16:27:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067235.329185, de2d5475-ec56-47dc-aa29-8a3ff80e3f0d => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:27:15 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] VM Resumed (Lifecycle Event)
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:27:15 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Instance spawned successfully.
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:15 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067235.3329458, de2d5475-ec56-47dc-aa29-8a3ff80e3f0d => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:27:15 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] VM Started (Lifecycle Event)
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:27:15 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:27:15 user nova-compute[73627]: INFO nova.compute.manager [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Took 10.11 seconds to spawn the instance on the hypervisor.
Aug 26 16:27:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:15 user nova-compute[73627]: INFO nova.compute.manager [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Took 11.55 seconds to build instance.
Aug 26 16:27:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-74af6b3f-8ffb-49de-aeba-3b856cb2ce19 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.757s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:17 user nova-compute[73627]: INFO nova.compute.manager [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Terminating instance
Aug 26 16:27:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-498ccf4f-0a60-4272-ae0f-a52bfdcc567b req-29b4e44f-3cb4-41a9-9819-c3fe424e56b3 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-vif-unplugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-498ccf4f-0a60-4272-ae0f-a52bfdcc567b req-29b4e44f-3cb4-41a9-9819-c3fe424e56b3 service nova] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-498ccf4f-0a60-4272-ae0f-a52bfdcc567b req-29b4e44f-3cb4-41a9-9819-c3fe424e56b3 service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-498ccf4f-0a60-4272-ae0f-a52bfdcc567b req-29b4e44f-3cb4-41a9-9819-c3fe424e56b3 service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-498ccf4f-0a60-4272-ae0f-a52bfdcc567b req-29b4e44f-3cb4-41a9-9819-c3fe424e56b3 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] No waiting events found dispatching network-vif-unplugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-498ccf4f-0a60-4272-ae0f-a52bfdcc567b req-29b4e44f-3cb4-41a9-9819-c3fe424e56b3 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-vif-unplugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:18 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Instance destroyed successfully.
Aug 26 16:27:18 user nova-compute[73627]: DEBUG nova.objects.instance [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lazy-loading 'resources' on Instance uuid 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:23:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1463194229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1463194229',id=8,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Sj6yy35YwIDlvvvihzQymqFhoon7RMyC7OSNPYjzgUeKCKw+OuVT0CMoXlNszZUBa6Mj8sVK/09WRxOxBs8UryT21dkwjmnJCwl3Lu9BmupDqwjouXifLfMdb3Sz8bg==',key_name='tempest-keypair-339813193',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5b9b0bdf908482ea1645968ddc1ba73',ramdisk_id='',reservation_id='r-cb6v5hvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130913096',owner_user_name='tempest-TaggedAttachmentsTest-1130913096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:24:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d553291cb27f449bb89c46add55e67e3',uuid=7329f0f0-e851-4a58-92b6-4edc3f9ec5e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:18 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converting VIF {"id": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "address": "fa:16:3e:2f:bb:ce", "network": {"id": "f2f8a669-ca79-4a20-8877-55f92defd76b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195141290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b9b0bdf908482ea1645968ddc1ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa75b9117-90", "ovs_interfaceid": "a75b9117-9045-4d5f-8b40-028c8f498bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:18 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:bb:ce,bridge_name='br-int',has_traffic_filtering=True,id=a75b9117-9045-4d5f-8b40-028c8f498bb9,network=Network(f2f8a669-ca79-4a20-8877-55f92defd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa75b9117-90') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:18 user nova-compute[73627]: DEBUG os_vif [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:bb:ce,bridge_name='br-int',has_traffic_filtering=True,id=a75b9117-9045-4d5f-8b40-028c8f498bb9,network=Network(f2f8a669-ca79-4a20-8877-55f92defd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa75b9117-90') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa75b9117-90, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:18 user nova-compute[73627]: INFO os_vif [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:bb:ce,bridge_name='br-int',has_traffic_filtering=True,id=a75b9117-9045-4d5f-8b40-028c8f498bb9,network=Network(f2f8a669-ca79-4a20-8877-55f92defd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa75b9117-90')
Aug 26 16:27:18 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Deleting instance files /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8_del
Aug 26 16:27:18 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Deletion of /opt/stack/data/nova/instances/7329f0f0-e851-4a58-92b6-4edc3f9ec5e8_del complete
Aug 26 16:27:18 user nova-compute[73627]: INFO nova.compute.manager [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 16:27:18 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:27:18 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:27:18 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:27:19 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:19 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Took 1.33 seconds to deallocate network for instance.
Aug 26 16:27:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-78b112de-def4-443c-9d0f-6a60c12c1d57 req-5fb7c18d-92ac-4fb8-8bc5-d82f03213295 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-vif-deleted-a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-d029fe63-95b5-4fc8-bbd6-5dbb27a36b01 req-2083cd20-9066-45cf-a48c-d9a0bd336251 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received event network-vif-plugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d029fe63-95b5-4fc8-bbd6-5dbb27a36b01 req-2083cd20-9066-45cf-a48c-d9a0bd336251 service nova] Acquiring lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d029fe63-95b5-4fc8-bbd6-5dbb27a36b01 req-2083cd20-9066-45cf-a48c-d9a0bd336251 service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d029fe63-95b5-4fc8-bbd6-5dbb27a36b01 req-2083cd20-9066-45cf-a48c-d9a0bd336251 service nova] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-d029fe63-95b5-4fc8-bbd6-5dbb27a36b01 req-2083cd20-9066-45cf-a48c-d9a0bd336251 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] No waiting events found dispatching network-vif-plugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:19 user nova-compute[73627]: WARNING nova.compute.manager [req-d029fe63-95b5-4fc8-bbd6-5dbb27a36b01 req-2083cd20-9066-45cf-a48c-d9a0bd336251 service nova] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Received unexpected event network-vif-plugged-a75b9117-9045-4d5f-8b40-028c8f498bb9 for instance with vm_state deleted and task_state None.
Aug 26 16:27:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:20 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:27:20 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:27:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:20 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Deleted allocations for instance 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8
Aug 26 16:27:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5dbfd021-7912-4b79-9f26-33372cd57c26 tempest-TaggedAttachmentsTest-1130913096 tempest-TaggedAttachmentsTest-1130913096-project-member] Lock "7329f0f0-e851-4a58-92b6-4edc3f9ec5e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.956s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:25 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067230.4673846, 3b4253a4-1436-4026-8549-f48f1bb8f121 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:27:25 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] VM Stopped (Lifecycle Event)
Aug 26 16:27:25 user nova-compute[73627]: DEBUG nova.compute.manager [None req-46b01b1f-3f19-4da7-ae92-6e6dcde3aed5 None None] [instance: 3b4253a4-1436-4026-8549-f48f1bb8f121] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:32 user nova-compute[73627]: DEBUG nova.compute.manager [req-46d188f4-5301-46f4-a6f3-68ec6794b6e3 req-2afc9b19-2e3a-478b-a272-420d3fdd97b7 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-changed-9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:32 user nova-compute[73627]: DEBUG nova.compute.manager [req-46d188f4-5301-46f4-a6f3-68ec6794b6e3 req-2afc9b19-2e3a-478b-a272-420d3fdd97b7 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing instance network info cache due to event network-changed-9adc995e-548e-4c77-9ce2-42abba1ddc8a. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:27:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-46d188f4-5301-46f4-a6f3-68ec6794b6e3 req-2afc9b19-2e3a-478b-a272-420d3fdd97b7 service nova] Acquiring lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:27:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-46d188f4-5301-46f4-a6f3-68ec6794b6e3 req-2afc9b19-2e3a-478b-a272-420d3fdd97b7 service nova] Acquired lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:27:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-46d188f4-5301-46f4-a6f3-68ec6794b6e3 req-2afc9b19-2e3a-478b-a272-420d3fdd97b7 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Refreshing network info cache for port 9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:27:33 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067238.1720486, 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:27:33 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] VM Stopped (Lifecycle Event)
Aug 26 16:27:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bad1f274-ebeb-4a7a-a5a2-32f0d9599385 None None] [instance: 7329f0f0-e851-4a58-92b6-4edc3f9ec5e8] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:33 user nova-compute[73627]: DEBUG nova.network.neutron [req-46d188f4-5301-46f4-a6f3-68ec6794b6e3 req-2afc9b19-2e3a-478b-a272-420d3fdd97b7 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updated VIF entry in instance network info cache for port 9adc995e-548e-4c77-9ce2-42abba1ddc8a. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:27:33 user nova-compute[73627]: DEBUG nova.network.neutron [req-46d188f4-5301-46f4-a6f3-68ec6794b6e3 req-2afc9b19-2e3a-478b-a272-420d3fdd97b7 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [{"id": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "address": "fa:16:3e:5e:97:1a", "network": {"id": "b9e80f57-f3a7-4dea-baa9-0c731b953efe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1451618830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adc995e-54", "ovs_interfaceid": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-46d188f4-5301-46f4-a6f3-68ec6794b6e3 req-2afc9b19-2e3a-478b-a272-420d3fdd97b7 service nova] Releasing lock "refresh_cache-6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:35 user nova-compute[73627]: INFO nova.compute.manager [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Terminating instance
Aug 26 16:27:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG nova.compute.manager [req-2d348d56-2b19-46de-bf96-ee377ea7c67b req-99ae7f29-523d-443b-a36e-f1070e480966 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-changed-d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG nova.compute.manager [req-2d348d56-2b19-46de-bf96-ee377ea7c67b req-99ae7f29-523d-443b-a36e-f1070e480966 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing instance network info cache due to event network-changed-d01767e2-a65b-4bbd-ae31-97eccf191447. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2d348d56-2b19-46de-bf96-ee377ea7c67b req-99ae7f29-523d-443b-a36e-f1070e480966 service nova] Acquiring lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2d348d56-2b19-46de-bf96-ee377ea7c67b req-99ae7f29-523d-443b-a36e-f1070e480966 service nova] Acquired lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:27:35 user nova-compute[73627]: DEBUG nova.network.neutron [req-2d348d56-2b19-46de-bf96-ee377ea7c67b req-99ae7f29-523d-443b-a36e-f1070e480966 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Refreshing network info cache for port d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-8c5c2d0b-22f3-49ac-ba8e-77992f003b02 req-d118531a-8091-4334-8b1f-ce2ca7073948 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8c5c2d0b-22f3-49ac-ba8e-77992f003b02 req-d118531a-8091-4334-8b1f-ce2ca7073948 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8c5c2d0b-22f3-49ac-ba8e-77992f003b02 req-d118531a-8091-4334-8b1f-ce2ca7073948 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8c5c2d0b-22f3-49ac-ba8e-77992f003b02 req-d118531a-8091-4334-8b1f-ce2ca7073948 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-8c5c2d0b-22f3-49ac-ba8e-77992f003b02 req-d118531a-8091-4334-8b1f-ce2ca7073948 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-unplugged-a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-8c5c2d0b-22f3-49ac-ba8e-77992f003b02 req-d118531a-8091-4334-8b1f-ce2ca7073948 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-a6b1395b-20a9-448b-97be-e353b593be0e for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG nova.network.neutron [req-2d348d56-2b19-46de-bf96-ee377ea7c67b req-99ae7f29-523d-443b-a36e-f1070e480966 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updated VIF entry in instance network info cache for port d01767e2-a65b-4bbd-ae31-97eccf191447. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG nova.network.neutron [req-2d348d56-2b19-46de-bf96-ee377ea7c67b req-99ae7f29-523d-443b-a36e-f1070e480966 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [{"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2d348d56-2b19-46de-bf96-ee377ea7c67b req-99ae7f29-523d-443b-a36e-f1070e480966 service nova] Releasing lock "refresh_cache-f961b797-16bd-43bd-8735-93578f1084cf" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Instance destroyed successfully.
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lazy-loading 'resources' on Instance uuid 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "address": "fa:16:3e:5e:97:1a", "network": {"id": "b9e80f57-f3a7-4dea-baa9-0c731b953efe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1451618830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adc995e-54", "ovs_interfaceid": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "address": "fa:16:3e:5e:97:1a", "network": {"id": "b9e80f57-f3a7-4dea-baa9-0c731b953efe", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1451618830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9adc995e-54", "ovs_interfaceid": "9adc995e-548e-4c77-9ce2-42abba1ddc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:97:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adc995e-548e-4c77-9ce2-42abba1ddc8a,network=Network(b9e80f57-f3a7-4dea-baa9-0c731b953efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adc995e-54') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:97:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adc995e-548e-4c77-9ce2-42abba1ddc8a,network=Network(b9e80f57-f3a7-4dea-baa9-0c731b953efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adc995e-54') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9adc995e-54, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: INFO os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:97:1a,bridge_name='br-int',has_traffic_filtering=True,id=9adc995e-548e-4c77-9ce2-42abba1ddc8a,network=Network(b9e80f57-f3a7-4dea-baa9-0c731b953efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9adc995e-54')
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:dc:e6,bridge_name='br-int',has_traffic_filtering=True,id=8d5d4266-25e9-425f-ac4f-80fd24af6c31,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5d4266-25') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:dc:e6,bridge_name='br-int',has_traffic_filtering=True,id=8d5d4266-25e9-425f-ac4f-80fd24af6c31,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5d4266-25') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d5d4266-25, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: INFO os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:dc:e6,bridge_name='br-int',has_traffic_filtering=True,id=8d5d4266-25e9-425f-ac4f-80fd24af6c31,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d5d4266-25')
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:06,bridge_name='br-int',has_traffic_filtering=True,id=1c1a1228-7701-4e82-872b-23fbde018c1d,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c1a1228-77') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:06,bridge_name='br-int',has_traffic_filtering=True,id=1c1a1228-7701-4e82-872b-23fbde018c1d,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c1a1228-77') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c1a1228-77, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: INFO os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:06,bridge_name='br-int',has_traffic_filtering=True,id=1c1a1228-7701-4e82-872b-23fbde018c1d,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c1a1228-77')
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:fb,bridge_name='br-int',has_traffic_filtering=True,id=a6b1395b-20a9-448b-97be-e353b593be0e,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b1395b-20') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:fb,bridge_name='br-int',has_traffic_filtering=True,id=a6b1395b-20a9-448b-97be-e353b593be0e,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b1395b-20') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6b1395b-20, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: INFO os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:fb,bridge_name='br-int',has_traffic_filtering=True,id=a6b1395b-20a9-448b-97be-e353b593be0e,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b1395b-20')
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:12:f3,bridge_name='br-int',has_traffic_filtering=True,id=c5f8ae0b-fc44-4b0f-bc7d-af523931bf04,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f8ae0b-fc') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:12:f3,bridge_name='br-int',has_traffic_filtering=True,id=c5f8ae0b-fc44-4b0f-bc7d-af523931bf04,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f8ae0b-fc') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5f8ae0b-fc, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: INFO os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:12:f3,bridge_name='br-int',has_traffic_filtering=True,id=c5f8ae0b-fc44-4b0f-bc7d-af523931bf04,network=Network(5e9947fa-096c-416e-8a16-4d22e7abeda6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f8ae0b-fc')
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=ad329dfb-604d-4430-8b10-787465b4cc8d,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad329dfb-60') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=ad329dfb-604d-4430-8b10-787465b4cc8d,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad329dfb-60') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad329dfb-60, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:37 user nova-compute[73627]: DEBUG nova.compute.manager [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-1c1a1228-7701-4e82-872b-23fbde018c1d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-unplugged-1c1a1228-7701-4e82-872b-23fbde018c1d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-1c1a1228-7701-4e82-872b-23fbde018c1d for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-1c1a1228-7701-4e82-872b-23fbde018c1d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-1c1a1228-7701-4e82-872b-23fbde018c1d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:38 user nova-compute[73627]: WARNING nova.compute.manager [req-17db48d5-ba72-4784-b79f-b8dd50df3932 req-4932e7bc-e918-41c4-99a2-f0f5cba5e1ea service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-1c1a1228-7701-4e82-872b-23fbde018c1d for instance with vm_state active and task_state deleting.
Aug 26 16:27:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:38 user nova-compute[73627]: INFO os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=ad329dfb-604d-4430-8b10-787465b4cc8d,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad329dfb-60')
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517302870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517302870',id=12,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1pGV00Ykboo4S7V7mBMYDWWH4bCt0YEoLv7PoGJs9gPHGCSS3jggrAAmpxLNSDYCvcd4xA5SD838Qp3n5Euw/lQG+ptPkyApNVl8B/3+1BgncT5y0GB90W4UAu06l+g==',key_name='tempest-keypair-308235665',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66759aba5e2e4d859ccff1255e821a64',ramdisk_id='',reservation_id='r-y0zom1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-192220641',owner_user_name='tempest-TaggedBootDevicesTest_v242-192220641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7ed97bdd2c487798ba4608ba5a2625',uuid=6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converting VIF {"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:7b:e0,bridge_name='br-int',has_traffic_filtering=True,id=c76ad503-8a97-4627-a8a7-46bc2f3e2055,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc76ad503-8a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7b:e0,bridge_name='br-int',has_traffic_filtering=True,id=c76ad503-8a97-4627-a8a7-46bc2f3e2055,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc76ad503-8a') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc76ad503-8a, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:38 user nova-compute[73627]: INFO os_vif [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7b:e0,bridge_name='br-int',has_traffic_filtering=True,id=c76ad503-8a97-4627-a8a7-46bc2f3e2055,network=Network(4c13c8e5-9949-40c2-9adf-120158289ed1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc76ad503-8a')
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkSOWxKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:27:38 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a025e5-9ac1-4c87-ada1-e7c8599f5a46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1900ca32-c4ea-4e51-a179-1a78c234ddf0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d01076d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[086ac2af-4848-4a75-93a8-c7c766ab671a]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[552873bd-83af-4d8e-ac0a-ca4ff64daa4e]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5450ff53-1e20-471e-acc6-740b30a9cfd9]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d755bf45-d897-43b9-9946-d034f5f8623a]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d81cff-c2ac-4172-8435-932c48064e17]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a6b9d3-1dea-4f50-97f7-42eb740c3e33]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175, portal: 172.16.0.220,3260]
Aug 26 16:27:38 user nova-compute[73627]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175, portal: 172.16.0.220,3260] successful.
Aug 26 16:27:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2046ca53-76ca-4a65-a4af-48a244aec175 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[596d3c09-d268-4093-9be1-74bfd29b2e40]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] <== disconnect_volume: return (392ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZJGMRDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:27:38 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef62612-e316-445f-a08d-cc7fcd4a0615]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebee5e09-908a-4738-b090-64b806775dd5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e82c51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f'): ({'sdd'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Removing single pathed devices sdd {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1292ca1-e2db-4641-a8ce-5b7a055172f2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[555dd0dd-b200-4d06-98be-8e3760772429]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Flushing IO for device /dev/sdd {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[70836694-a0a2-43d8-9a8c-f8acc783f7ed]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f3d28b-12b1-49fc-b35e-501ad7cd86c7]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:38 user nova-compute[73627]: WARNING nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-a6b1395b-20a9-448b-97be-e353b593be0e for instance with vm_state active and task_state deleting.
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-unplugged-ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-ad329dfb-604d-4430-8b10-787465b4cc8d for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:38 user nova-compute[73627]: WARNING nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-ad329dfb-604d-4430-8b10-787465b4cc8d for instance with vm_state active and task_state deleting.
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-unplugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:38 user nova-compute[73627]: WARNING nova.compute.manager [req-d4efa0a0-8339-4c55-9432-bf2168a19796 req-83d0d08c-f5fc-4de6-920b-581e2a32082c service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-c76ad503-8a97-4627-a8a7-46bc2f3e2055 for instance with vm_state active and task_state deleting.
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb9bac9-dc51-493c-920d-32163c63dc81]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edc7079-9408-4158-8c31-560f6d00b37e]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f, portal: 172.16.0.220,3260]
Aug 26 16:27:38 user nova-compute[73627]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f, portal: 172.16.0.220,3260] successful.
Aug 26 16:27:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30dde7b-4560-4014-947f-77034a17e57f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c5e08-63e7-41ca-b353-c7a00e824905]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] <== disconnect_volume: return (391ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNemdLRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:27:38 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "f961b797-16bd-43bd-8735-93578f1084cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:38 user nova-compute[73627]: INFO nova.compute.manager [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Terminating instance
Aug 26 16:27:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc685ce9-fd7d-4754-a7b7-bef2bbe75637]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fd2b8c-15c0-40e6-908f-c15cd99d43d4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:27:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d029f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84'): ({'sde'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Removing single pathed devices sde {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c024de-1c8a-4913-83ae-45368bd30336]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8f48a9-0b64-48c2-86b7-d67cb55f73ba]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Flushing IO for device /dev/sde {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e76eef3-cb1b-4145-b4f9-ade1172a790d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb65b73-744b-4c8e-9fbc-1a454a008392]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b035b7c2-3044-410f-a7ab-5871b10ce5bc]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e07422-227e-4680-8b36-841876d21ebd]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84, portal: 172.16.0.220,3260]
Aug 26 16:27:39 user nova-compute[73627]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84, portal: 172.16.0.220,3260] successful.
Aug 26 16:27:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd34708-26e7-4e70-9268-9713314c6f84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11016b5-af83-45a9-ad62-394444fade03]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] <== disconnect_volume: return (375ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:27:39 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Deleting instance files /opt/stack/data/nova/instances/6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9_del
Aug 26 16:27:39 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Deletion of /opt/stack/data/nova/instances/6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9_del complete
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: INFO nova.compute.manager [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Took 3.61 seconds to destroy the instance on the hypervisor.
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:27:39 user nova-compute[73627]: INFO nova.compute.claims [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Claim successful on node user
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-9fd88f4a-830f-4937-870e-a43c11ced2f9 req-f02347fd-6b7b-452f-b666-0b513b3ed0bc service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9fd88f4a-830f-4937-870e-a43c11ced2f9 req-f02347fd-6b7b-452f-b666-0b513b3ed0bc service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9fd88f4a-830f-4937-870e-a43c11ced2f9 req-f02347fd-6b7b-452f-b666-0b513b3ed0bc service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9fd88f4a-830f-4937-870e-a43c11ced2f9 req-f02347fd-6b7b-452f-b666-0b513b3ed0bc service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-9fd88f4a-830f-4937-870e-a43c11ced2f9 req-f02347fd-6b7b-452f-b666-0b513b3ed0bc service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-unplugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-9fd88f4a-830f-4937-870e-a43c11ced2f9 req-f02347fd-6b7b-452f-b666-0b513b3ed0bc service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.946s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-unplugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:40 user nova-compute[73627]: WARNING nova.compute.manager [req-037a4ac8-ed54-41f4-8b35-28cfbd634a85 req-7f1a4507-6366-4e68-a05c-6d5b559a2b5b service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-e0e633e2-4663-405f-a0f4-b9dc5b3712a9 for instance with vm_state active and task_state deleting.
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:27:40 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:27:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:27:41 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Instance destroyed successfully.
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.objects.instance [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lazy-loading 'resources' on Instance uuid f961b797-16bd-43bd-8735-93578f1084cf {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:0a:94,bridge_name='br-int',has_traffic_filtering=True,id=d01767e2-a65b-4bbd-ae31-97eccf191447,network=Network(eafd9e23-3342-4d6b-a908-2973064b8b31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01767e2-a6') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:0a:94,bridge_name='br-int',has_traffic_filtering=True,id=d01767e2-a65b-4bbd-ae31-97eccf191447,network=Network(eafd9e23-3342-4d6b-a908-2973064b8b31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01767e2-a6') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd01767e2-a6, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:27:41 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Creating image(s)
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "/opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "/opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "/opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: INFO os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:0a:94,bridge_name='br-int',has_traffic_filtering=True,id=d01767e2-a65b-4bbd-ae31-97eccf191447,network=Network(eafd9e23-3342-4d6b-a908-2973064b8b31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01767e2-a6')
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b5:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0e633e2-4663-405f-a0f4-b9dc5b3712a9,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0e633e2-46') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b5:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0e633e2-4663-405f-a0f4-b9dc5b3712a9,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0e633e2-46') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.policy [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd633720332174fe9a29c1b7775698982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc034dfcf2a3437b9b505fc54cd014a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0e633e2-46, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: INFO os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b5:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0e633e2-4663-405f-a0f4-b9dc5b3712a9,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0e633e2-46')
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ff6530f-236c-4e59-b361-36cbc188b9f7,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff6530f-23') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ff6530f-236c-4e59-b361-36cbc188b9f7,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff6530f-23') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ff6530f-23, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: INFO os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:7c:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ff6530f-236c-4e59-b361-36cbc188b9f7,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff6530f-23')
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=fb075d9c-38a0-4fe7-a3ad-3ccd4db43646,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb075d9c-38') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=fb075d9c-38a0-4fe7-a3ad-3ccd4db43646,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb075d9c-38') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb075d9c-38, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.239s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-292dad8e-801e-45b4-83f6-7195b1c645c1 req-b50abcb6-7a48-4686-8cd1-274557a6713e service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Received event network-changed-a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-292dad8e-801e-45b4-83f6-7195b1c645c1 req-b50abcb6-7a48-4686-8cd1-274557a6713e service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Refreshing instance network info cache due to event network-changed-a71b2faa-f735-4db6-a598-7c86f1330002. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-292dad8e-801e-45b4-83f6-7195b1c645c1 req-b50abcb6-7a48-4686-8cd1-274557a6713e service nova] Acquiring lock "refresh_cache-5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-292dad8e-801e-45b4-83f6-7195b1c645c1 req-b50abcb6-7a48-4686-8cd1-274557a6713e service nova] Acquired lock "refresh_cache-5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.neutron [req-292dad8e-801e-45b4-83f6-7195b1c645c1 req-b50abcb6-7a48-4686-8cd1-274557a6713e service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Refreshing network info cache for port a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:41 user nova-compute[73627]: INFO os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=fb075d9c-38a0-4fe7-a3ad-3ccd4db43646,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb075d9c-38')
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:08:db,bridge_name='br-int',has_traffic_filtering=True,id=89f0db97-51c1-44f3-8009-1624dfa94db4,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0db97-51') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:08:db,bridge_name='br-int',has_traffic_filtering=True,id=89f0db97-51c1-44f3-8009-1624dfa94db4,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0db97-51') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89f0db97-51, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: INFO os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:08:db,bridge_name='br-int',has_traffic_filtering=True,id=89f0db97-51c1-44f3-8009-1624dfa94db4,network=Network(7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0db97-51')
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:46:d7,bridge_name='br-int',has_traffic_filtering=True,id=0417fa30-6f31-4ecb-a6e4-a25accad0428,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0417fa30-6f') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:46:d7,bridge_name='br-int',has_traffic_filtering=True,id=0417fa30-6f31-4ecb-a6e4-a25accad0428,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0417fa30-6f') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0417fa30-6f, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: INFO os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:46:d7,bridge_name='br-int',has_traffic_filtering=True,id=0417fa30-6f31-4ecb-a6e4-a25accad0428,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0417fa30-6f')
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T16:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111092014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111092014',id=13,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWYs4TneBI1nLgDUCxuaydkAXkLEubNiWnpryhd5yy5nlq9gvbQn9hNBEmqBj4Bm7V3SCL4nUQSjo9qHtEA29U6AjuUnnFJ8BR7QfDRbgiXy+Ald5ZurvwJP+kJEdW/7w==',key_name='tempest-keypair-1361783274',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2462ff948ebb487d92ac3a3e2b281102',ramdisk_id='',reservation_id='r-zjgz7aon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2086654860',owner_user_name='tempest-TaggedBootDevicesTest-2086654860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53847c7a2cea42f8ae4aeecea2053ca7',uuid=f961b797-16bd-43bd-8735-93578f1084cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converting VIF {"id": "60158f05-7509-4976-85e8-fdeff3b26a24", "address": "fa:16:3e:b2:3c:26", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60158f05-75", "ovs_interfaceid": "60158f05-7509-4976-85e8-fdeff3b26a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:26,bridge_name='br-int',has_traffic_filtering=True,id=60158f05-7509-4976-85e8-fdeff3b26a24,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60158f05-75') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:26,bridge_name='br-int',has_traffic_filtering=True,id=60158f05-7509-4976-85e8-fdeff3b26a24,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60158f05-75') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60158f05-75, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:41 user nova-compute[73627]: INFO os_vif [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3c:26,bridge_name='br-int',has_traffic_filtering=True,id=60158f05-7509-4976-85e8-fdeff3b26a24,network=Network(be67f3ab-b869-47b2-a4bb-dc1c288911b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60158f05-75')
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmOjtqBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:27:41 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4231c2cc-6aae-4f65-a839-40c332ac17fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.211s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b011681-729c-4594-bdb0-3b265877781e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:41 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:41 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:41 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:27:41 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:27:41 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:41 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:41 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:41 user nova-compute[73627]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 (non-flash)
Aug 26 16:27:41 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:27:41 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d0107490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242'): ({'sdg'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Removing single pathed devices sdg {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk 1073741824" returned: 0 in 0.061s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[200dc10a-23ce-44cc-b4a2-61c6554321db]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c607d163-04aa-4d3c-951c-43800bbd3305]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Flushing IO for device /dev/sdg {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d77c661-11a3-4e9f-8dcc-233ed89b0c33]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86547a9-a3a5-4ded-a304-80e24af2b2aa]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] SCSI volumes sdg have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4470203b-d06c-43ea-b282-8d95f9dcfaad]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:41 user nova-compute[73627]: INFO nova.compute.manager [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Terminating instance
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.273s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:27:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8477dd5-e298-4622-8e05-a6cd281770a6]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242, portal: 172.16.0.220,3260]
Aug 26 16:27:42 user nova-compute[73627]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242, portal: 172.16.0.220,3260] successful.
Aug 26 16:27:42 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:42 user nova-compute[73627]: WARNING nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-9adc995e-548e-4c77-9ce2-42abba1ddc8a for instance with vm_state active and task_state deleting.
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-unplugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:42 user nova-compute[73627]: WARNING nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-8d5d4266-25e9-425f-ac4f-80fd24af6c31 for instance with vm_state active and task_state deleting.
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-unplugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-unplugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-plugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Acquiring lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] No waiting events found dispatching network-vif-plugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:42 user nova-compute[73627]: WARNING nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received unexpected event network-vif-plugged-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 for instance with vm_state active and task_state deleting.
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-unplugged-d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbe1eaee-bc7f-48f5-8fe7-7770656fd1e2 req-fab160d2-4a6c-4664-a000-e754ff0b0761 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-d01767e2-a65b-4bbd-ae31-97eccf191447 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9b2c748-f107-4a1d-87a3-dbbe8f232242 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d27a68-c417-473d-ab67-bb3a7d450e0a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.482s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] <== disconnect_volume: return (484ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVXgtGyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:27:42 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf4be6-9612-4972-9205-bbb1ca7bfcf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb0b6b8-f1c1-4080-a4fc-52a2cabb6453]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d0107520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19'): ({'sdh'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Removing single pathed devices sdh {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Cannot resize image /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Ensure instance console log exists: /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eef1a9-1f01-458f-b5a8-cee00f27f6c5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbec46c-d200-48c5-93f2-c5bcda9cc57c]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Flushing IO for device /dev/sdh {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83105a7-aa50-43ea-b0ec-af062af94020]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc58a5fc-e254-4b3a-9581-aa101e0ae770]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] SCSI volumes sdh have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7192fc4-1876-4bcf-825d-bd9dba59f9fc]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e006268-824f-4a51-aff9-70d465a19f5f]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19, portal: 172.16.0.220,3260]
Aug 26 16:27:42 user nova-compute[73627]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19, portal: 172.16.0.220,3260] successful.
Aug 26 16:27:42 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d03986-90cc-44b3-a12a-345b32664c19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b95064f-15d6-4b05-b47b-ce255504a821]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] <== disconnect_volume: return (348ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARJdboHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:27:42 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9470fc4e-7a36-4b6c-b747-060a82d6e200]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54993ba-0302-44dc-a105-4a1206997fbd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:27:42 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e83d1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5'): ({'sdi'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Removing single pathed devices sdi {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1714892-0365-45d2-b25f-0edb682d0b84]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a15afe5-81d0-4570-9aac-e10fe93dd32e]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Flushing IO for device /dev/sdi {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e09cc7-941c-46c5-a13e-ecfb4c9674e3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.057s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[437abb98-4611-41ff-89df-8cfd7b56d9e7]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] SCSI volumes sdi have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f6ebd6-1d59-4db9-a584-94d3f5ff30dd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Instance destroyed successfully.
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'resources' on Instance uuid 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-747050381',display_name='tempest-AttachVolumeNegativeTest-server-747050381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-747050381',id=14,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQQAwgccHYD7pbVY/lg2dEyu3JKFoDadGiGigauAYtETMS2eUeBEXczgaQUtxHYJ//9bjVWbQmxsFGAiON2LBIWeCDR+Oc+VticJUYRd9DQ8mjroAmkdWK/stWazSw3ag==',key_name='tempest-keypair-1880200258',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-7ab0109o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a71b2faa-f735-4db6-a598-7c86f1330002", "address": "fa:16:3e:da:0b:03", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71b2faa-f7", "ovs_interfaceid": "a71b2faa-f735-4db6-a598-7c86f1330002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "a71b2faa-f735-4db6-a598-7c86f1330002", "address": "fa:16:3e:da:0b:03", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71b2faa-f7", "ovs_interfaceid": "a71b2faa-f735-4db6-a598-7c86f1330002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:0b:03,bridge_name='br-int',has_traffic_filtering=True,id=a71b2faa-f735-4db6-a598-7c86f1330002,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71b2faa-f7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_vif [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:0b:03,bridge_name='br-int',has_traffic_filtering=True,id=a71b2faa-f735-4db6-a598-7c86f1330002,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71b2faa-f7') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa71b2faa-f7, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:42 user nova-compute[73627]: INFO os_vif [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:0b:03,bridge_name='br-int',has_traffic_filtering=True,id=a71b2faa-f735-4db6-a598-7c86f1330002,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71b2faa-f7')
Aug 26 16:27:42 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Deleting instance files /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8_del
Aug 26 16:27:42 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Deletion of /opt/stack/data/nova/instances/5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8_del complete
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.129s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb2d486-bb3e-4d81-99dd-1f26557ea674]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5, portal: 172.16.0.220,3260]
Aug 26 16:27:42 user nova-compute[73627]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5, portal: 172.16.0.220,3260] successful.
Aug 26 16:27:42 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c23dce-9a2f-4659-a509-c67bcf9060f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a2d8eb-fbeb-4688-9a10-10b4b8e46ea6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] <== disconnect_volume: return (422ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:27:42 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Deleting instance files /opt/stack/data/nova/instances/f961b797-16bd-43bd-8735-93578f1084cf_del
Aug 26 16:27:42 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Deletion of /opt/stack/data/nova/instances/f961b797-16bd-43bd-8735-93578f1084cf_del complete
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-unplugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:42 user nova-compute[73627]: WARNING nova.compute.manager [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 for instance with vm_state active and task_state deleting.
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-unplugged-89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-7cf35526-3796-4393-b278-55bd5cb342d4 req-d366a212-2fd3-4dd5-8df8-4b50e3616f75 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-89f0db97-51c1-44f3-8009-1624dfa94db4 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:42 user nova-compute[73627]: INFO nova.compute.manager [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 26 16:27:42 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:27:42 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:27:43 user nova-compute[73627]: INFO nova.compute.manager [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Took 4.17 seconds to destroy the instance on the hypervisor.
Aug 26 16:27:43 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: f961b797-16bd-43bd-8735-93578f1084cf] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG nova.network.neutron [req-292dad8e-801e-45b4-83f6-7195b1c645c1 req-b50abcb6-7a48-4686-8cd1-274557a6713e service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Updated VIF entry in instance network info cache for port a71b2faa-f735-4db6-a598-7c86f1330002. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG nova.network.neutron [req-292dad8e-801e-45b4-83f6-7195b1c645c1 req-b50abcb6-7a48-4686-8cd1-274557a6713e service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Updating instance_info_cache with network_info: [{"id": "a71b2faa-f735-4db6-a598-7c86f1330002", "address": "fa:16:3e:da:0b:03", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71b2faa-f7", "ovs_interfaceid": "a71b2faa-f735-4db6-a598-7c86f1330002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-292dad8e-801e-45b4-83f6-7195b1c645c1 req-b50abcb6-7a48-4686-8cd1-274557a6713e service nova] Releasing lock "refresh_cache-5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Received event network-vif-unplugged-a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] Acquiring lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] No waiting events found dispatching network-vif-unplugged-a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Received event network-vif-unplugged-a71b2faa-f735-4db6-a598-7c86f1330002 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Received event network-vif-plugged-a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] Acquiring lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] No waiting events found dispatching network-vif-plugged-a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:43 user nova-compute[73627]: WARNING nova.compute.manager [req-8591981c-5565-49e3-a10f-a5a182312f4b req-6c64f295-86f1-48b4-a163-e8ad98228421 service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Received unexpected event network-vif-plugged-a71b2faa-f735-4db6-a598-7c86f1330002 for instance with vm_state active and task_state deleting.
Aug 26 16:27:43 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Successfully created port: ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:44 user nova-compute[73627]: WARNING nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-d01767e2-a65b-4bbd-ae31-97eccf191447 for instance with vm_state active and task_state deleting.
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-unplugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:44 user nova-compute[73627]: WARNING nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-7ff6530f-236c-4e59-b361-36cbc188b9f7 for instance with vm_state active and task_state deleting.
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-unplugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:44 user nova-compute[73627]: WARNING nova.compute.manager [req-7061ab6a-0cc8-420a-b49a-2593a2995b08 req-26be26ae-a4d8-476e-863a-bf335881a55a service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-0417fa30-6f31-4ecb-a6e4-a25accad0428 for instance with vm_state active and task_state deleting.
Aug 26 16:27:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:45 user nova-compute[73627]: WARNING nova.compute.manager [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-89f0db97-51c1-44f3-8009-1624dfa94db4 for instance with vm_state active and task_state deleting.
Aug 26 16:27:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-unplugged-60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-unplugged-60158f05-7509-4976-85e8-fdeff3b26a24 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-plugged-60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] Acquiring lock "f961b797-16bd-43bd-8735-93578f1084cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] Lock "f961b797-16bd-43bd-8735-93578f1084cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] No waiting events found dispatching network-vif-plugged-60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:45 user nova-compute[73627]: WARNING nova.compute.manager [req-c68fe910-c7ee-4268-af16-4f6011f2d2cb req-c20df787-5cda-4eb0-8283-481a4a488d0c service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received unexpected event network-vif-plugged-60158f05-7509-4976-85e8-fdeff3b26a24 for instance with vm_state active and task_state deleting.
Aug 26 16:27:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:45 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Took 2.35 seconds to deallocate network for instance.
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:45 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Deleted allocations for instance 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8
Aug 26 16:27:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ccf4665-e1f6-4c31-8126-d64bcb785d07 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.063s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Successfully updated port: ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquired lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-42c5648e-a02c-4bbd-92e2-84c1abf3db59 req-468f30c8-6509-4f00-8b74-951e286a18cc service nova] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Received event network-vif-deleted-a71b2faa-f735-4db6-a598-7c86f1330002 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-42c5648e-a02c-4bbd-92e2-84c1abf3db59 req-468f30c8-6509-4f00-8b74-951e286a18cc service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-deleted-60158f05-7509-4976-85e8-fdeff3b26a24 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:46 user nova-compute[73627]: INFO nova.compute.manager [req-42c5648e-a02c-4bbd-92e2-84c1abf3db59 req-468f30c8-6509-4f00-8b74-951e286a18cc service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Neutron deleted interface 60158f05-7509-4976-85e8-fdeff3b26a24; detaching it from the instance and deleting it from the info cache
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.network.neutron [req-42c5648e-a02c-4bbd-92e2-84c1abf3db59 req-468f30c8-6509-4f00-8b74-951e286a18cc service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [{"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "address": "fa:16:3e:60:46:d7", "network": {"id": "be67f3ab-b869-47b2-a4bb-dc1c288911b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1953523440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0417fa30-6f", "ovs_interfaceid": "0417fa30-6f31-4ecb-a6e4-a25accad0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-42c5648e-a02c-4bbd-92e2-84c1abf3db59 req-468f30c8-6509-4f00-8b74-951e286a18cc service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Detach interface failed, port_id=60158f05-7509-4976-85e8-fdeff3b26a24, reason: Instance f961b797-16bd-43bd-8735-93578f1084cf could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating instance_info_cache with network_info: [{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Releasing lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance network_info: |[{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Start _get_guest_xml network_info=[{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:27:46 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:27:46 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1150395174',display_name='tempest-ServerActionsTestOtherB-server-1150395174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1150395174',id=19,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsMLcp+BUGxkTU5eO6A9fURs5JKJUKrz971vfnvzmwjrONPq4qpNUgYZ+CzdRhMT1bKtdKKOR19LocoMu/yIF+ku4vNBbvF97/+zoHaRx1dCCz3qB4DhdvvVw1Om3Llw==',key_name='tempest-keypair-646039968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc034dfcf2a3437b9b505fc54cd014a6',ramdisk_id='',reservation_id='r-c0b38pf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1300226985',owner_user_name='tempest-ServerActionsTestOtherB-1300226985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:27:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d633720332174fe9a29c1b7775698982',uuid=19c82f60-3294-4a09-96a3-b03a1673149c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converting VIF {"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.objects.instance [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lazy-loading 'pci_devices' on Instance uuid 19c82f60-3294-4a09-96a3-b03a1673149c {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:27:46 user nova-compute[73627]:   <uuid>19c82f60-3294-4a09-96a3-b03a1673149c</uuid>
Aug 26 16:27:46 user nova-compute[73627]:   <name>instance-00000013</name>
Aug 26 16:27:46 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:27:46 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:27:46 user nova-compute[73627]:   <metadata>
Aug 26 16:27:46 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:27:46 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:27:46 user nova-compute[73627]:       <nova:name>tempest-ServerActionsTestOtherB-server-1150395174</nova:name>
Aug 26 16:27:46 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:27:46</nova:creationTime>
Aug 26 16:27:46 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:27:46 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:27:46 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:27:46 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:27:46 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:27:46 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:27:46 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:27:46 user nova-compute[73627]:       <nova:owner>
Aug 26 16:27:46 user nova-compute[73627]:         <nova:user uuid="d633720332174fe9a29c1b7775698982">tempest-ServerActionsTestOtherB-1300226985-project-member</nova:user>
Aug 26 16:27:46 user nova-compute[73627]:         <nova:project uuid="dc034dfcf2a3437b9b505fc54cd014a6">tempest-ServerActionsTestOtherB-1300226985</nova:project>
Aug 26 16:27:46 user nova-compute[73627]:       </nova:owner>
Aug 26 16:27:46 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:27:46 user nova-compute[73627]:       <nova:ports>
Aug 26 16:27:46 user nova-compute[73627]:         <nova:port uuid="ae911fbe-6ac5-4ef1-8224-47806a42627b">
Aug 26 16:27:46 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 16:27:46 user nova-compute[73627]:         </nova:port>
Aug 26 16:27:46 user nova-compute[73627]:       </nova:ports>
Aug 26 16:27:46 user nova-compute[73627]:     </nova:instance>
Aug 26 16:27:46 user nova-compute[73627]:   </metadata>
Aug 26 16:27:46 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:27:46 user nova-compute[73627]:     <system>
Aug 26 16:27:46 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:27:46 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:27:46 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:27:46 user nova-compute[73627]:       <entry name="serial">19c82f60-3294-4a09-96a3-b03a1673149c</entry>
Aug 26 16:27:46 user nova-compute[73627]:       <entry name="uuid">19c82f60-3294-4a09-96a3-b03a1673149c</entry>
Aug 26 16:27:46 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:27:46 user nova-compute[73627]:     </system>
Aug 26 16:27:46 user nova-compute[73627]:   </sysinfo>
Aug 26 16:27:46 user nova-compute[73627]:   <os>
Aug 26 16:27:46 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:27:46 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:27:46 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:27:46 user nova-compute[73627]:   </os>
Aug 26 16:27:46 user nova-compute[73627]:   <features>
Aug 26 16:27:46 user nova-compute[73627]:     <acpi/>
Aug 26 16:27:46 user nova-compute[73627]:     <apic/>
Aug 26 16:27:46 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:27:46 user nova-compute[73627]:   </features>
Aug 26 16:27:46 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:27:46 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:27:46 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:27:46 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:27:46 user nova-compute[73627]:   </clock>
Aug 26 16:27:46 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:27:46 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:27:46 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:27:46 user nova-compute[73627]:   </cpu>
Aug 26 16:27:46 user nova-compute[73627]:   <devices>
Aug 26 16:27:46 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:27:46 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:27:46 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk"/>
Aug 26 16:27:46 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:27:46 user nova-compute[73627]:     </disk>
Aug 26 16:27:46 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:27:46 user nova-compute[73627]:       <mac address="fa:16:3e:4a:53:d2"/>
Aug 26 16:27:46 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:27:46 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:27:46 user nova-compute[73627]:       <target dev="tapae911fbe-6a"/>
Aug 26 16:27:46 user nova-compute[73627]:     </interface>
Aug 26 16:27:46 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:27:46 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/console.log" append="off"/>
Aug 26 16:27:46 user nova-compute[73627]:     </serial>
Aug 26 16:27:46 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:27:46 user nova-compute[73627]:     <video>
Aug 26 16:27:46 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:27:46 user nova-compute[73627]:     </video>
Aug 26 16:27:46 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:27:46 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:27:46 user nova-compute[73627]:     </rng>
Aug 26 16:27:46 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:27:46 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:27:46 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:27:46 user nova-compute[73627]:     </memballoon>
Aug 26 16:27:46 user nova-compute[73627]:   </devices>
Aug 26 16:27:46 user nova-compute[73627]: </domain>
Aug 26 16:27:46 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1150395174',display_name='tempest-ServerActionsTestOtherB-server-1150395174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1150395174',id=19,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsMLcp+BUGxkTU5eO6A9fURs5JKJUKrz971vfnvzmwjrONPq4qpNUgYZ+CzdRhMT1bKtdKKOR19LocoMu/yIF+ku4vNBbvF97/+zoHaRx1dCCz3qB4DhdvvVw1Om3Llw==',key_name='tempest-keypair-646039968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc034dfcf2a3437b9b505fc54cd014a6',ramdisk_id='',reservation_id='r-c0b38pf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1300226985',owner_user_name='tempest-ServerActionsTestOtherB-1300226985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:27:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d633720332174fe9a29c1b7775698982',uuid=19c82f60-3294-4a09-96a3-b03a1673149c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converting VIF {"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG os_vif [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae911fbe-6a, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae911fbe-6a, col_values=(('external_ids', {'iface-id': 'ae911fbe-6ac5-4ef1-8224-47806a42627b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:53:d2', 'vm-uuid': '19c82f60-3294-4a09-96a3-b03a1673149c'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:46 user nova-compute[73627]: INFO os_vif [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a')
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:27:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] No VIF found with MAC fa:16:3e:4a:53:d2, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:27:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-deleted-9adc995e-548e-4c77-9ce2-42abba1ddc8a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:47 user nova-compute[73627]: INFO nova.compute.manager [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Neutron deleted interface 9adc995e-548e-4c77-9ce2-42abba1ddc8a; detaching it from the instance and deleting it from the info cache
Aug 26 16:27:47 user nova-compute[73627]: DEBUG nova.network.neutron [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [{"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad329dfb-604d-4430-8b10-787465b4cc8d", "address": "fa:16:3e:1d:ba:71", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad329dfb-60", "ovs_interfaceid": "ad329dfb-604d-4430-8b10-787465b4cc8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Detach interface failed, port_id=9adc995e-548e-4c77-9ce2-42abba1ddc8a, reason: Instance 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:27:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-changed-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Refreshing instance network info cache due to event network-changed-ae911fbe-6ac5-4ef1-8224-47806a42627b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:27:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] Acquiring lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:27:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] Acquired lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:27:47 user nova-compute[73627]: DEBUG nova.network.neutron [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Refreshing network info cache for port ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:27:47 user nova-compute[73627]: DEBUG nova.network.neutron [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updated VIF entry in instance network info cache for port ae911fbe-6ac5-4ef1-8224-47806a42627b. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:27:47 user nova-compute[73627]: DEBUG nova.network.neutron [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating instance_info_cache with network_info: [{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] Releasing lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:27:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-deleted-ad329dfb-604d-4430-8b10-787465b4cc8d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:47 user nova-compute[73627]: INFO nova.compute.manager [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Neutron deleted interface ad329dfb-604d-4430-8b10-787465b4cc8d; detaching it from the instance and deleting it from the info cache
Aug 26 16:27:47 user nova-compute[73627]: DEBUG nova.network.neutron [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [{"id": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "address": "fa:16:3e:e9:dc:e6", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d4266-25", "ovs_interfaceid": "8d5d4266-25e9-425f-ac4f-80fd24af6c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c1a1228-7701-4e82-872b-23fbde018c1d", "address": "fa:16:3e:ce:17:06", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1a1228-77", "ovs_interfaceid": "1c1a1228-7701-4e82-872b-23fbde018c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a6b1395b-20a9-448b-97be-e353b593be0e", "address": "fa:16:3e:e7:ff:fb", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b1395b-20", "ovs_interfaceid": "a6b1395b-20a9-448b-97be-e353b593be0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "address": "fa:16:3e:94:12:f3", "network": {"id": "5e9947fa-096c-416e-8a16-4d22e7abeda6", "bridge": "br-int", "label": "tempest-device-tagging-net1-760312848", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f8ae0b-fc", "ovs_interfaceid": "c5f8ae0b-fc44-4b0f-bc7d-af523931bf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "address": "fa:16:3e:88:7b:e0", "network": {"id": "4c13c8e5-9949-40c2-9adf-120158289ed1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680730574", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "66759aba5e2e4d859ccff1255e821a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc76ad503-8a", "ovs_interfaceid": "c76ad503-8a97-4627-a8a7-46bc2f3e2055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-a0240aa1-4b11-49d3-a875-2e229dc8e9bf req-8b9dcd82-eb68-4206-abac-bf2992d23043 service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Detach interface failed, port_id=ad329dfb-604d-4430-8b10-787465b4cc8d, reason: Instance 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:48 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Took 8.94 seconds to deallocate network for instance.
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-deleted-0417fa30-6f31-4ecb-a6e4-a25accad0428 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:48 user nova-compute[73627]: INFO nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Neutron deleted interface 0417fa30-6f31-4ecb-a6e4-a25accad0428; detaching it from the instance and deleting it from the info cache
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.network.neutron [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [{"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "address": "fa:16:3e:99:e9:f8", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb075d9c-38", "ovs_interfaceid": "fb075d9c-38a0-4fe7-a3ad-3ccd4db43646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Detach interface failed, port_id=0417fa30-6f31-4ecb-a6e4-a25accad0428, reason: Instance f961b797-16bd-43bd-8735-93578f1084cf could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-deleted-fb075d9c-38a0-4fe7-a3ad-3ccd4db43646 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:48 user nova-compute[73627]: INFO nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Neutron deleted interface fb075d9c-38a0-4fe7-a3ad-3ccd4db43646; detaching it from the instance and deleting it from the info cache
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.network.neutron [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [{"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "89f0db97-51c1-44f3-8009-1624dfa94db4", "address": "fa:16:3e:3f:08:db", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0db97-51", "ovs_interfaceid": "89f0db97-51c1-44f3-8009-1624dfa94db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Detach interface failed, port_id=fb075d9c-38a0-4fe7-a3ad-3ccd4db43646, reason: Instance f961b797-16bd-43bd-8735-93578f1084cf could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-deleted-89f0db97-51c1-44f3-8009-1624dfa94db4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:48 user nova-compute[73627]: INFO nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Neutron deleted interface 89f0db97-51c1-44f3-8009-1624dfa94db4; detaching it from the instance and deleting it from the info cache
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.network.neutron [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [{"id": "d01767e2-a65b-4bbd-ae31-97eccf191447", "address": "fa:16:3e:5a:0a:94", "network": {"id": "eafd9e23-3342-4d6b-a908-2973064b8b31", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1281623821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01767e2-a6", "ovs_interfaceid": "d01767e2-a65b-4bbd-ae31-97eccf191447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "address": "fa:16:3e:e7:b5:ef", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0e633e2-46", "ovs_interfaceid": "e0e633e2-4663-405f-a0f4-b9dc5b3712a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "address": "fa:16:3e:ab:7c:5f", "network": {"id": "7c3c01dd-a56d-4529-bdfc-ddea6b8bbd4e", "bridge": "br-int", "label": "tempest-device-tagging-net1-708109959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2462ff948ebb487d92ac3a3e2b281102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff6530f-23", "ovs_interfaceid": "7ff6530f-236c-4e59-b361-36cbc188b9f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Detach interface failed, port_id=89f0db97-51c1-44f3-8009-1624dfa94db4, reason: Instance f961b797-16bd-43bd-8735-93578f1084cf could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:48 user nova-compute[73627]: WARNING nova.compute.manager [req-8833795f-3ea7-413d-a360-321b332d4152 req-d0a226e8-cd93-4fcc-8af6-48c0fa61cfd2 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received unexpected event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with vm_state building and task_state spawning.
Aug 26 16:27:48 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Took 5.70 seconds to deallocate network for instance.
Aug 26 16:27:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-490c9a36-6d54-4ebc-931b-6da58ce3003f req-f5dfea56-54df-4ee7-b81c-3363d4d6bb7b service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-deleted-c76ad503-8a97-4627-a8a7-46bc2f3e2055 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-490c9a36-6d54-4ebc-931b-6da58ce3003f req-f5dfea56-54df-4ee7-b81c-3363d4d6bb7b service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-deleted-c5f8ae0b-fc44-4b0f-bc7d-af523931bf04 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-490c9a36-6d54-4ebc-931b-6da58ce3003f req-f5dfea56-54df-4ee7-b81c-3363d4d6bb7b service nova] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Received event network-vif-deleted-a6b1395b-20a9-448b-97be-e353b593be0e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067270.3986976, 19c82f60-3294-4a09-96a3-b03a1673149c => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:27:50 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] VM Resumed (Lifecycle Event)
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:27:50 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance spawned successfully.
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:27:50 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067270.3999515, 19c82f60-3294-4a09-96a3-b03a1673149c => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:27:50 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] VM Started (Lifecycle Event)
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:27:50 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:27:50 user nova-compute[73627]: INFO nova.compute.manager [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Took 9.42 seconds to spawn the instance on the hypervisor.
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-3181a97b-b279-4364-bf0d-7dc2bd0d3c08 req-26cbc34e-87b6-4da2-be36-40b8f2e6e329 service nova] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Received event network-vif-deleted-d01767e2-a65b-4bbd-ae31-97eccf191447 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-3181a97b-b279-4364-bf0d-7dc2bd0d3c08 req-26cbc34e-87b6-4da2-be36-40b8f2e6e329 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3181a97b-b279-4364-bf0d-7dc2bd0d3c08 req-26cbc34e-87b6-4da2-be36-40b8f2e6e329 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3181a97b-b279-4364-bf0d-7dc2bd0d3c08 req-26cbc34e-87b6-4da2-be36-40b8f2e6e329 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3181a97b-b279-4364-bf0d-7dc2bd0d3c08 req-26cbc34e-87b6-4da2-be36-40b8f2e6e329 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-3181a97b-b279-4364-bf0d-7dc2bd0d3c08 req-26cbc34e-87b6-4da2-be36-40b8f2e6e329 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:50 user nova-compute[73627]: WARNING nova.compute.manager [req-3181a97b-b279-4364-bf0d-7dc2bd0d3c08 req-26cbc34e-87b6-4da2-be36-40b8f2e6e329 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received unexpected event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with vm_state building and task_state spawning.
Aug 26 16:27:50 user nova-compute[73627]: INFO nova.compute.manager [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Took 11.19 seconds to build instance.
Aug 26 16:27:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a6b32363-1498-473a-8d8b-05cbdf23e08b tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.307s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:51 user nova-compute[73627]: INFO nova.compute.manager [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Took 2.67 seconds to detach 3 volumes for instance.
Aug 26 16:27:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:51 user nova-compute[73627]: INFO nova.compute.manager [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Took 2.55 seconds to detach 3 volumes for instance.
Aug 26 16:27:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:51 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:27:51 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:27:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.164s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:51 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Deleted allocations for instance 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9
Aug 26 16:27:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e55f9ee1-4949-400f-8db0-612400a4d23d tempest-TaggedBootDevicesTest_v242-192220641 tempest-TaggedBootDevicesTest_v242-192220641-project-member] Lock "6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.883s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:51 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:27:51 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:27:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:51 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Deleted allocations for instance f961b797-16bd-43bd-8735-93578f1084cf
Aug 26 16:27:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-df7bb04f-3f8b-4e5a-bd49-2ef23cafed6b tempest-TaggedBootDevicesTest-2086654860 tempest-TaggedBootDevicesTest-2086654860-project-member] Lock "f961b797-16bd-43bd-8735-93578f1084cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.210s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:52 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067257.5836103, 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:27:52 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] VM Stopped (Lifecycle Event)
Aug 26 16:27:52 user nova-compute[73627]: DEBUG nova.compute.manager [None req-33585cc8-5831-4376-93ea-a1f04872741d None None] [instance: 6fbce0f3-edba-4a9f-8bce-2d0ecab76dd9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:56 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067261.041709, f961b797-16bd-43bd-8735-93578f1084cf => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:27:56 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: f961b797-16bd-43bd-8735-93578f1084cf] VM Stopped (Lifecycle Event)
Aug 26 16:27:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-71c4b4ec-2de4-4560-b67b-7912eea7fa96 None None] [instance: f961b797-16bd-43bd-8735-93578f1084cf] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:27:57 user nova-compute[73627]: INFO nova.compute.manager [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Rescuing
Aug 26 16:27:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:27:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquired lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:27:57 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:27:57 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067262.7491853, 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:27:57 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] VM Stopped (Lifecycle Event)
Aug 26 16:27:57 user nova-compute[73627]: DEBUG nova.compute.manager [None req-dcae425d-1cbc-449a-aaa1-53d46ea4de15 None None] [instance: 5bcd7e4b-0ec9-4c1a-b137-9a1f9062f6a8] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:27:57 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updating instance_info_cache with network_info: [{"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:27:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Releasing lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:27:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-fb9fb5e6-7d6b-4003-8bb3-bef03a916bbc req-77ac90d6-cdb7-4b4d-8767-0add74d1824c service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-unplugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fb9fb5e6-7d6b-4003-8bb3-bef03a916bbc req-77ac90d6-cdb7-4b4d-8767-0add74d1824c service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fb9fb5e6-7d6b-4003-8bb3-bef03a916bbc req-77ac90d6-cdb7-4b4d-8767-0add74d1824c service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fb9fb5e6-7d6b-4003-8bb3-bef03a916bbc req-77ac90d6-cdb7-4b4d-8767-0add74d1824c service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-fb9fb5e6-7d6b-4003-8bb3-bef03a916bbc req-77ac90d6-cdb7-4b4d-8767-0add74d1824c service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-unplugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:27:58 user nova-compute[73627]: WARNING nova.compute.manager [req-fb9fb5e6-7d6b-4003-8bb3-bef03a916bbc req-77ac90d6-cdb7-4b4d-8767-0add74d1824c service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received unexpected event network-vif-unplugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with vm_state active and task_state rescuing.
Aug 26 16:27:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:58 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Instance destroyed successfully.
Aug 26 16:27:58 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Attempting rescue
Aug 26 16:27:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73627) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Instance directory exists: not creating {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 16:27:58 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Creating image(s)
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "/opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.193s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.rescue {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.rescue" returned: 0 in 0.053s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:27:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'migration_context' on Instance uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.objects.base [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<6907d670-3efe-473c-b03c-eb26c4b7ef4e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Start _get_guest_xml network_info=[{"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "vif_mac": "fa:16:3e:92:0b:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'resources' on Instance uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.objects.base [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<6907d670-3efe-473c-b03c-eb26c4b7ef4e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'numa_topology' on Instance uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.objects.base [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<6907d670-3efe-473c-b03c-eb26c4b7ef4e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:27:59 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:27:59 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.objects.base [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<6907d670-3efe-473c-b03c-eb26c4b7ef4e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1444531241',display_name='tempest-ServerRescueNegativeTestJSON-server-1444531241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1444531241',id=3,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-ec4k8e0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:23:29Z,user_data=None,user_id='acdf029015a64f89aa51e6559e0f962c',uuid=6907d670-3efe-473c-b03c-eb26c4b7ef4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "vif_mac": "fa:16:3e:92:0b:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "vif_mac": "fa:16:3e:92:0b:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:0b:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b801568-1011-4cc6-8a1b-b15d44abf741,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b801568-10') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'pci_devices' on Instance uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.objects.base [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<6907d670-3efe-473c-b03c-eb26c4b7ef4e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:27:59 user nova-compute[73627]:   <uuid>6907d670-3efe-473c-b03c-eb26c4b7ef4e</uuid>
Aug 26 16:27:59 user nova-compute[73627]:   <name>instance-00000003</name>
Aug 26 16:27:59 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:27:59 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:27:59 user nova-compute[73627]:   <metadata>
Aug 26 16:27:59 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:27:59 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:27:59 user nova-compute[73627]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1444531241</nova:name>
Aug 26 16:27:59 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:27:59</nova:creationTime>
Aug 26 16:27:59 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:27:59 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:27:59 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:27:59 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:27:59 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:27:59 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:27:59 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:27:59 user nova-compute[73627]:       <nova:owner>
Aug 26 16:27:59 user nova-compute[73627]:         <nova:user uuid="acdf029015a64f89aa51e6559e0f962c">tempest-ServerRescueNegativeTestJSON-1187038007-project-member</nova:user>
Aug 26 16:27:59 user nova-compute[73627]:         <nova:project uuid="9f6269e1e9de40b5a5b295651a6fd9b3">tempest-ServerRescueNegativeTestJSON-1187038007</nova:project>
Aug 26 16:27:59 user nova-compute[73627]:       </nova:owner>
Aug 26 16:27:59 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:27:59 user nova-compute[73627]:       <nova:ports>
Aug 26 16:27:59 user nova-compute[73627]:         <nova:port uuid="7b801568-1011-4cc6-8a1b-b15d44abf741">
Aug 26 16:27:59 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 16:27:59 user nova-compute[73627]:         </nova:port>
Aug 26 16:27:59 user nova-compute[73627]:       </nova:ports>
Aug 26 16:27:59 user nova-compute[73627]:     </nova:instance>
Aug 26 16:27:59 user nova-compute[73627]:   </metadata>
Aug 26 16:27:59 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:27:59 user nova-compute[73627]:     <system>
Aug 26 16:27:59 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:27:59 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:27:59 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:27:59 user nova-compute[73627]:       <entry name="serial">6907d670-3efe-473c-b03c-eb26c4b7ef4e</entry>
Aug 26 16:27:59 user nova-compute[73627]:       <entry name="uuid">6907d670-3efe-473c-b03c-eb26c4b7ef4e</entry>
Aug 26 16:27:59 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:27:59 user nova-compute[73627]:     </system>
Aug 26 16:27:59 user nova-compute[73627]:   </sysinfo>
Aug 26 16:27:59 user nova-compute[73627]:   <os>
Aug 26 16:27:59 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:27:59 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:27:59 user nova-compute[73627]:   </os>
Aug 26 16:27:59 user nova-compute[73627]:   <features>
Aug 26 16:27:59 user nova-compute[73627]:     <acpi/>
Aug 26 16:27:59 user nova-compute[73627]:     <apic/>
Aug 26 16:27:59 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:27:59 user nova-compute[73627]:   </features>
Aug 26 16:27:59 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:27:59 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:27:59 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:27:59 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:27:59 user nova-compute[73627]:   </clock>
Aug 26 16:27:59 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:27:59 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:27:59 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:27:59 user nova-compute[73627]:   </cpu>
Aug 26 16:27:59 user nova-compute[73627]:   <devices>
Aug 26 16:27:59 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:27:59 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:27:59 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.rescue"/>
Aug 26 16:27:59 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:27:59 user nova-compute[73627]:     </disk>
Aug 26 16:27:59 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:27:59 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:27:59 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk"/>
Aug 26 16:27:59 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:27:59 user nova-compute[73627]:     </disk>
Aug 26 16:27:59 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:27:59 user nova-compute[73627]:       <mac address="fa:16:3e:92:0b:2d"/>
Aug 26 16:27:59 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:27:59 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:27:59 user nova-compute[73627]:       <target dev="tap7b801568-10"/>
Aug 26 16:27:59 user nova-compute[73627]:     </interface>
Aug 26 16:27:59 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:27:59 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/console.log" append="off"/>
Aug 26 16:27:59 user nova-compute[73627]:     </serial>
Aug 26 16:27:59 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:27:59 user nova-compute[73627]:     <video>
Aug 26 16:27:59 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:27:59 user nova-compute[73627]:     </video>
Aug 26 16:27:59 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:27:59 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:27:59 user nova-compute[73627]:     </rng>
Aug 26 16:27:59 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:27:59 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:27:59 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:27:59 user nova-compute[73627]:     </memballoon>
Aug 26 16:27:59 user nova-compute[73627]:   </devices>
Aug 26 16:27:59 user nova-compute[73627]: </domain>
Aug 26 16:27:59 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:27:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Instance destroyed successfully.
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No VIF found with MAC fa:16:3e:92:0b:2d, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:27:59 user nova-compute[73627]: INFO nova.compute.manager [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Terminating instance
Aug 26 16:27:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:27:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-03d7d83a-8c6c-49c9-bc9d-0be020f814f5 req-123f396a-a216-4504-9cfa-634c5f4daeb6 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-vif-unplugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-03d7d83a-8c6c-49c9-bc9d-0be020f814f5 req-123f396a-a216-4504-9cfa-634c5f4daeb6 service nova] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-03d7d83a-8c6c-49c9-bc9d-0be020f814f5 req-123f396a-a216-4504-9cfa-634c5f4daeb6 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-03d7d83a-8c6c-49c9-bc9d-0be020f814f5 req-123f396a-a216-4504-9cfa-634c5f4daeb6 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-03d7d83a-8c6c-49c9-bc9d-0be020f814f5 req-123f396a-a216-4504-9cfa-634c5f4daeb6 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] No waiting events found dispatching network-vif-unplugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-03d7d83a-8c6c-49c9-bc9d-0be020f814f5 req-123f396a-a216-4504-9cfa-634c5f4daeb6 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-vif-unplugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-0170d115-7aee-4c87-a769-4740727394a1 req-1c7dcfd0-e402-4e52-9a11-b3b0d8fa2d6d service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0170d115-7aee-4c87-a769-4740727394a1 req-1c7dcfd0-e402-4e52-9a11-b3b0d8fa2d6d service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0170d115-7aee-4c87-a769-4740727394a1 req-1c7dcfd0-e402-4e52-9a11-b3b0d8fa2d6d service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0170d115-7aee-4c87-a769-4740727394a1 req-1c7dcfd0-e402-4e52-9a11-b3b0d8fa2d6d service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-0170d115-7aee-4c87-a769-4740727394a1 req-1c7dcfd0-e402-4e52-9a11-b3b0d8fa2d6d service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:28:00 user nova-compute[73627]: WARNING nova.compute.manager [req-0170d115-7aee-4c87-a769-4740727394a1 req-1c7dcfd0-e402-4e52-9a11-b3b0d8fa2d6d service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received unexpected event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with vm_state active and task_state rescuing.
Aug 26 16:28:00 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Instance destroyed successfully.
Aug 26 16:28:00 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lazy-loading 'resources' on Instance uuid f34a8233-5a54-4a28-b57f-096e8526e80e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-305755365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-221217757',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZg30xf6ADFM2OrxzbSgKjl2I1mfRaXR7ksJbPemPRCTfCXrd27g1yT4kPNFBVdl+SB80btIVwzCgShhqlwfrFbHefKSSkDAwBQ1ev0GfUUbSpBCNWTJ8+qVVI2IoozJQ==',key_name='tempest-keypair-661931287',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1c0c3d55d3c488a978986d609f8bdb9',ramdisk_id='',reservation_id='r-lj2vpcg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-332170589',owner_user_name='tempest-ServerActionsV293TestJSON-332170589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:26:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063c3d4f532c4a3da674054d3dfeb5de',uuid=f34a8233-5a54-4a28-b57f-096e8526e80e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converting VIF {"id": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "address": "fa:16:3e:7b:15:82", "network": {"id": "06296e89-2d1c-4b05-9694-41c320af954c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-105676881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1c0c3d55d3c488a978986d609f8bdb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8408461f-84", "ovs_interfaceid": "8408461f-84dc-4d3c-afa8-c6b8a2b8ab97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG os_vif [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8408461f-84, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:00 user nova-compute[73627]: INFO os_vif [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:15:82,bridge_name='br-int',has_traffic_filtering=True,id=8408461f-84dc-4d3c-afa8-c6b8a2b8ab97,network=Network(06296e89-2d1c-4b05-9694-41c320af954c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8408461f-84')
Aug 26 16:28:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEWqVeDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:28:00 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:28:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:28:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4803951f-754f-4936-9108-b0bf1b72c62e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[429bd7be-76da-4583-aa41-33ca2475d3f7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:28:01 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:28:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 (non-flash)
Aug 26 16:28:01 user nova-compute[73627]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:28:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d04b1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[313feacb-d150-4746-9c4a-f4b5fc376313]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcee58c-d957-4d1e-ab0d-d7c7993573b9]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d9a66d-bf3d-400c-aa6d-cc729482a3a8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e832523-85a9-42f1-8fb9-f4d63d7fce0a]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef31713-5ceb-48a5-9cd7-a2803a36bdf5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[06773678-1886-42c8-b802-a0a5c6cbfafd]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260]
Aug 26 16:28:01 user nova-compute[73627]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578, portal: 172.16.0.220,3260] successful.
Aug 26 16:28:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d582e6d4-e3f2-4216-8fa6-26ccfbc29578 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[43338a81-58b9-42e1-a4a0-852df53663bb]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] <== disconnect_volume: return (313ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:28:01 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Deleting instance files /opt/stack/data/nova/instances/f34a8233-5a54-4a28-b57f-096e8526e80e_del
Aug 26 16:28:01 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Deletion of /opt/stack/data/nova/instances/f34a8233-5a54-4a28-b57f-096e8526e80e_del complete
Aug 26 16:28:01 user nova-compute[73627]: INFO nova.compute.manager [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Took 1.59 seconds to destroy the instance on the hypervisor.
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:28:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-237af6f2-ca70-4299-b5ca-92039bcd5abb req-b8eaf830-0d9e-4b15-8516-e5c218a74c11 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-237af6f2-ca70-4299-b5ca-92039bcd5abb req-b8eaf830-0d9e-4b15-8516-e5c218a74c11 service nova] Acquiring lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-237af6f2-ca70-4299-b5ca-92039bcd5abb req-b8eaf830-0d9e-4b15-8516-e5c218a74c11 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-237af6f2-ca70-4299-b5ca-92039bcd5abb req-b8eaf830-0d9e-4b15-8516-e5c218a74c11 service nova] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-237af6f2-ca70-4299-b5ca-92039bcd5abb req-b8eaf830-0d9e-4b15-8516-e5c218a74c11 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] No waiting events found dispatching network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:28:02 user nova-compute[73627]: WARNING nova.compute.manager [req-237af6f2-ca70-4299-b5ca-92039bcd5abb req-b8eaf830-0d9e-4b15-8516-e5c218a74c11 service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received unexpected event network-vif-plugged-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 for instance with vm_state active and task_state deleting.
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:28:02 user nova-compute[73627]: WARNING nova.compute.manager [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received unexpected event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with vm_state active and task_state rescuing.
Aug 26 16:28:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:28:02 user nova-compute[73627]: WARNING nova.compute.manager [req-4e95a964-ad4c-43c4-816e-8013278b453a req-5a1393e4-d8ab-4f52-b587-cca6403fb483 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received unexpected event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with vm_state active and task_state rescuing.
Aug 26 16:28:02 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:28:02 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Took 1.13 seconds to deallocate network for instance.
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:03 user nova-compute[73627]: INFO nova.compute.manager [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Took 0.90 seconds to detach 1 volumes for instance.
Aug 26 16:28:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Removed pending event for 6907d670-3efe-473c-b03c-eb26c4b7ef4e due to event {{(pid=73627) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067283.4071064, 6907d670-3efe-473c-b03c-eb26c4b7ef4e => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:28:03 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] VM Resumed (Lifecycle Event)
Aug 26 16:28:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Deleting volume: d582e6d4-e3f2-4216-8fa6-26ccfbc29578 {{(pid=73627) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c9001826-ed0b-4e76-a091-bcd4928e712e tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:28:03 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 16:28:03 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067283.4077682, 6907d670-3efe-473c-b03c-eb26c4b7ef4e => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:28:03 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] VM Started (Lifecycle Event)
Aug 26 16:28:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.318s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-a6ff8b36-ebc6-4d87-95d3-638c5218891f req-8e98aca4-b2d3-4a6d-9715-7e1b3bdcae7b service nova] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Received event network-vif-deleted-8408461f-84dc-4d3c-afa8-c6b8a2b8ab97 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.652s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:04 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Deleted allocations for instance f34a8233-5a54-4a28-b57f-096e8526e80e
Aug 26 16:28:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4d283dae-c566-4b24-8c3d-2f15ecba5ebe tempest-ServerActionsV293TestJSON-332170589 tempest-ServerActionsV293TestJSON-332170589-project-member] Lock "f34a8233-5a54-4a28-b57f-096e8526e80e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.866s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:28:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:07 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:28:07 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:28:07 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=7337MB free_disk=25.624187469482422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:28:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a20c0a68-9781-4d6c-8f55-6952f1758f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de2d5475-ec56-47dc-aa29-8a3ff80e3f0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19c82f60-3294-4a09-96a3-b03a1673149c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:28:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:28:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:28:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:28:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:28:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:28:09 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Updating instance_info_cache with network_info: [{"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:28:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:15 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067280.8875175, f34a8233-5a54-4a28-b57f-096e8526e80e => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:28:15 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] VM Stopped (Lifecycle Event)
Aug 26 16:28:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-3133e287-579b-4d48-b569-121ca9f8f2ea None None] [instance: f34a8233-5a54-4a28-b57f-096e8526e80e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:28:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-9e75f480-84e2-465e-aa8b-8152d019c47c req-3f08c4aa-30cc-432f-90aa-4b3977d378a2 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-changed-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-9e75f480-84e2-465e-aa8b-8152d019c47c req-3f08c4aa-30cc-432f-90aa-4b3977d378a2 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Refreshing instance network info cache due to event network-changed-cfd70b91-61a4-4ad8-9354-412fb74106c1. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:28:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e75f480-84e2-465e-aa8b-8152d019c47c req-3f08c4aa-30cc-432f-90aa-4b3977d378a2 service nova] Acquiring lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:28:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e75f480-84e2-465e-aa8b-8152d019c47c req-3f08c4aa-30cc-432f-90aa-4b3977d378a2 service nova] Acquired lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:28:31 user nova-compute[73627]: DEBUG nova.network.neutron [req-9e75f480-84e2-465e-aa8b-8152d019c47c req-3f08c4aa-30cc-432f-90aa-4b3977d378a2 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Refreshing network info cache for port cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:28:33 user nova-compute[73627]: DEBUG nova.network.neutron [req-9e75f480-84e2-465e-aa8b-8152d019c47c req-3f08c4aa-30cc-432f-90aa-4b3977d378a2 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Updated VIF entry in instance network info cache for port cfd70b91-61a4-4ad8-9354-412fb74106c1. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:28:33 user nova-compute[73627]: DEBUG nova.network.neutron [req-9e75f480-84e2-465e-aa8b-8152d019c47c req-3f08c4aa-30cc-432f-90aa-4b3977d378a2 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Updating instance_info_cache with network_info: [{"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:28:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e75f480-84e2-465e-aa8b-8152d019c47c req-3f08c4aa-30cc-432f-90aa-4b3977d378a2 service nova] Releasing lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:28:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:35 user nova-compute[73627]: INFO nova.compute.manager [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Detaching volume 3387ec47-b471-4c68-a7bf-2129fa41edc9
Aug 26 16:28:35 user nova-compute[73627]: INFO nova.virt.block_device [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Attempting to driver detach volume 3387ec47-b471-4c68-a7bf-2129fa41edc9 from mountpoint /dev/vdb
Aug 26 16:28:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Attempting to detach device vdb from instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:28:35 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:28:35 user nova-compute[73627]:   <source dev="/dev/sdf"/>
Aug 26 16:28:35 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:28:35 user nova-compute[73627]:   <serial>3387ec47-b471-4c68-a7bf-2129fa41edc9</serial>
Aug 26 16:28:35 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:28:35 user nova-compute[73627]: </disk>
Aug 26 16:28:35 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:28:35 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully detached device vdb from instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 from the persistent domain config.
Aug 26 16:28:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:28:35 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:28:35 user nova-compute[73627]:   <source dev="/dev/sdf"/>
Aug 26 16:28:35 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:28:35 user nova-compute[73627]:   <serial>3387ec47-b471-4c68-a7bf-2129fa41edc9</serial>
Aug 26 16:28:35 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:28:35 user nova-compute[73627]: </disk>
Aug 26 16:28:35 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067315.68854, eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:28:35 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully detached device vdb from instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 from the live domain config.
Aug 26 16:28:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GrgFBvcM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:28:35 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.012s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[de958ed3-72fa-4231-b217-b5ffdd58f304]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8399383c-5fc2-40fd-a8a1-1de5aee3edef]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:28:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 (non-flash)
Aug 26 16:28:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d029c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9'): ({'sdf'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Removing single pathed devices sdf {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a05da3-2698-425a-ba31-b500bef29bd6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[17868676-5793-4ac9-ad21-a52e6126393d]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Flushing IO for device /dev/sdf {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[930707cc-8958-468a-b9a4-b4d472fe7f05]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e17ae8-e959-4bc4-915c-6d54dc645dc6]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] SCSI volumes sdf have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1965ef5-ec50-4d3c-97d7-96ec37a79d26]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b153c865-27a4-4f60-86c0-ad79ba80d33a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9, portal: 172.16.0.220,3260]
Aug 26 16:28:35 user nova-compute[73627]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9, portal: 172.16.0.220,3260] successful.
Aug 26 16:28:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3387ec47-b471-4c68-a7bf-2129fa41edc9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b5f100-abd6-4373-9627-9a32e8b30dfd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] <== disconnect_volume: return (306ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'flavor' on Instance uuid eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:28:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c4c345f1-2da2-41e9-898d-25d25725d28d tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.889s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:37 user nova-compute[73627]: INFO nova.compute.manager [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Attaching volume 6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 to /dev/vdb
Aug 26 16:28:37 user nova-compute[73627]: DEBUG os_brick.utils [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e8bd03-ce40-4549-9543-b370adc79a43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bb8e66-8ec3-4dde-8214-ee2a98cd75ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff1899-4456-4a3c-8e2a-6477929bb5e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f87ee-9fdf-4215-bc61-94211e61916c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:28:37 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:28:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[494431d0-316f-4ce7-8a47-109fc5f02fc0]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG os_brick.utils [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:28:37 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Updating existing volume attachment record: 1500905c-5c4e-4d66-ab83-5cf6d5ac9421 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:28:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:48 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:28:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:48 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:28:48 user nova-compute[73627]: INFO nova.compute.claims [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Claim successful on node user
Aug 26 16:28:49 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:28:49 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:28:49 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbWXUMcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:28:49 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:28:49 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:28:49 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[569f9384-5bc3-4d7c-814d-041404f9c0e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:28:49 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6051eeb6-2901-45b6-8b39-625a7ba73571]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5] added
Aug 26 16:28:49 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d0775d-e428-424f-b7bc-76b7b9d95669]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:28:49 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Creating image(s)
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "/opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "/opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cc0583-44e8-48f9-a334-9a82faac318b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbWXUMcd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbWXUMcd" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e391133-04dd-4b00-96fa-699244ecdae5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbWXUMcd'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG nova.policy [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c01a881f130f4cbe9c70e2acd4842b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93acb667ea194ce4b6f55e4e86fe9f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f306ff9-fea5-49f3-b3d6-2fe244367609]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee62c88-2320-4f78-a3c5-ed3f64b22300]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:28:49 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:28:49 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:28:49 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 16:28:49 user nova-compute[73627]: 
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e0be94-cec1-4b1f-ba91-cdc9ba6e4108]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260]
Aug 26 16:28:49 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260] successful.
Aug 26 16:28:49 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf36713c-66a3-413e-969c-7dc04276e2fe]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[027ca7a8-ac0e-4662-b59d-139edf63f745]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:28:49 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:28:49 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.229s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[076f0277-fa08-4340-8e3f-98043df54a89]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbWXUMcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk 1073741824" returned: 0 in 0.062s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.217s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Cannot resize image /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Ensure instance console log exists: /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26163333732616136', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163333732616136', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:28:50 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:28:50 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:28:50 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:28:50 user nova-compute[73627]:   <serial>6cb32b9d-e58b-4ea0-a116-be9b8797f5d5</serial>
Aug 26 16:28:50 user nova-compute[73627]: </disk>
Aug 26 16:28:50 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:28:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:51 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Successfully created port: acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:28:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:28:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:28:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No VIF found with MAC fa:16:3e:d1:9a:8b, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:28:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e573a05d-b6e5-4202-91e3-300794c9a7d0 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.339s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:28:51 user nova-compute[73627]: INFO nova.compute.manager [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] instance snapshotting
Aug 26 16:28:51 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Beginning live snapshot process
Aug 26 16:28:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json -f qcow2 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Successfully updated port: acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquired lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json -f qcow2" returned: 0 in 0.228s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json -f qcow2 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.compute.manager [req-9f401b92-dc03-4fc1-8d6c-c23d62e06a53 req-0cfe5f87-f1d7-4d17-a0bb-0dbd4bd20c9e service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-changed-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.compute.manager [req-9f401b92-dc03-4fc1-8d6c-c23d62e06a53 req-0cfe5f87-f1d7-4d17-a0bb-0dbd4bd20c9e service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Refreshing instance network info cache due to event network-changed-acc0dfcd-a792-461b-890b-47ad7a7ca1e4. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9f401b92-dc03-4fc1-8d6c-c23d62e06a53 req-0cfe5f87-f1d7-4d17-a0bb-0dbd4bd20c9e service nova] Acquiring lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0d3760d-1fe9-481d-b90c-57a1306035d9 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0d3760d-1fe9-481d-b90c-57a1306035d9 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b0d3760d-1fe9-481d-b90c-57a1306035d9 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b0d3760d-1fe9-481d-b90c-57a1306035d9 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73627) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b0d3760d-1fe9-481d-b90c-57a1306035d9 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.247s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9ckiyhia/b243daab3e5948d380324d5a35f707ed.delta 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9ckiyhia/b243daab3e5948d380324d5a35f707ed.delta 1073741824" returned: 0 in 0.067s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:52 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 16:28:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updating instance_info_cache with network_info: [{"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Releasing lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Instance network_info: |[{"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9f401b92-dc03-4fc1-8d6c-c23d62e06a53 req-0cfe5f87-f1d7-4d17-a0bb-0dbd4bd20c9e service nova] Acquired lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.network.neutron [req-9f401b92-dc03-4fc1-8d6c-c23d62e06a53 req-0cfe5f87-f1d7-4d17-a0bb-0dbd4bd20c9e service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Refreshing network info cache for port acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Start _get_guest_xml network_info=[{"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:28:52 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:28:52 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:28:52 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1313029250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1313029250',id=20,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Ve2IfJyqHfgM4j2Ukkn/LY683coRDCPGAAsz9e3ka/78aNiOeL/f3py3hYvGD8aA2KH2Z1BxUGJunxaaylIFIDdalkdbYI5hNec0W5iTvxkkLsdG3rIuOXZNIqtmbwg==',key_name='tempest-keypair-1653270261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-8sdto70b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=b1f798a4-a09c-4a10-ba68-650b7c757f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'pci_devices' on Instance uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:28:53 user nova-compute[73627]:   <uuid>b1f798a4-a09c-4a10-ba68-650b7c757f7f</uuid>
Aug 26 16:28:53 user nova-compute[73627]:   <name>instance-00000014</name>
Aug 26 16:28:53 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:28:53 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:28:53 user nova-compute[73627]:   <metadata>
Aug 26 16:28:53 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:28:53 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:28:53 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1313029250</nova:name>
Aug 26 16:28:53 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:28:52</nova:creationTime>
Aug 26 16:28:53 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:28:53 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:28:53 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:28:53 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:28:53 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:28:53 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:28:53 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:28:53 user nova-compute[73627]:       <nova:owner>
Aug 26 16:28:53 user nova-compute[73627]:         <nova:user uuid="c01a881f130f4cbe9c70e2acd4842b8d">tempest-AttachVolumeShelveTestJSON-2118968964-project-member</nova:user>
Aug 26 16:28:53 user nova-compute[73627]:         <nova:project uuid="93acb667ea194ce4b6f55e4e86fe9f5c">tempest-AttachVolumeShelveTestJSON-2118968964</nova:project>
Aug 26 16:28:53 user nova-compute[73627]:       </nova:owner>
Aug 26 16:28:53 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:28:53 user nova-compute[73627]:       <nova:ports>
Aug 26 16:28:53 user nova-compute[73627]:         <nova:port uuid="acc0dfcd-a792-461b-890b-47ad7a7ca1e4">
Aug 26 16:28:53 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 16:28:53 user nova-compute[73627]:         </nova:port>
Aug 26 16:28:53 user nova-compute[73627]:       </nova:ports>
Aug 26 16:28:53 user nova-compute[73627]:     </nova:instance>
Aug 26 16:28:53 user nova-compute[73627]:   </metadata>
Aug 26 16:28:53 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:28:53 user nova-compute[73627]:     <system>
Aug 26 16:28:53 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:28:53 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:28:53 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:28:53 user nova-compute[73627]:       <entry name="serial">b1f798a4-a09c-4a10-ba68-650b7c757f7f</entry>
Aug 26 16:28:53 user nova-compute[73627]:       <entry name="uuid">b1f798a4-a09c-4a10-ba68-650b7c757f7f</entry>
Aug 26 16:28:53 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:28:53 user nova-compute[73627]:     </system>
Aug 26 16:28:53 user nova-compute[73627]:   </sysinfo>
Aug 26 16:28:53 user nova-compute[73627]:   <os>
Aug 26 16:28:53 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:28:53 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:28:53 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:28:53 user nova-compute[73627]:   </os>
Aug 26 16:28:53 user nova-compute[73627]:   <features>
Aug 26 16:28:53 user nova-compute[73627]:     <acpi/>
Aug 26 16:28:53 user nova-compute[73627]:     <apic/>
Aug 26 16:28:53 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:28:53 user nova-compute[73627]:   </features>
Aug 26 16:28:53 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:28:53 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:28:53 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:28:53 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:28:53 user nova-compute[73627]:   </clock>
Aug 26 16:28:53 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:28:53 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:28:53 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:28:53 user nova-compute[73627]:   </cpu>
Aug 26 16:28:53 user nova-compute[73627]:   <devices>
Aug 26 16:28:53 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:28:53 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:28:53 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk"/>
Aug 26 16:28:53 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:28:53 user nova-compute[73627]:     </disk>
Aug 26 16:28:53 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:28:53 user nova-compute[73627]:       <mac address="fa:16:3e:10:da:20"/>
Aug 26 16:28:53 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:28:53 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:28:53 user nova-compute[73627]:       <target dev="tapacc0dfcd-a7"/>
Aug 26 16:28:53 user nova-compute[73627]:     </interface>
Aug 26 16:28:53 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:28:53 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/console.log" append="off"/>
Aug 26 16:28:53 user nova-compute[73627]:     </serial>
Aug 26 16:28:53 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:28:53 user nova-compute[73627]:     <video>
Aug 26 16:28:53 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:28:53 user nova-compute[73627]:     </video>
Aug 26 16:28:53 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:28:53 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:28:53 user nova-compute[73627]:     </rng>
Aug 26 16:28:53 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:28:53 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:28:53 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:28:53 user nova-compute[73627]:     </memballoon>
Aug 26 16:28:53 user nova-compute[73627]:   </devices>
Aug 26 16:28:53 user nova-compute[73627]: </domain>
Aug 26 16:28:53 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1313029250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1313029250',id=20,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Ve2IfJyqHfgM4j2Ukkn/LY683coRDCPGAAsz9e3ka/78aNiOeL/f3py3hYvGD8aA2KH2Z1BxUGJunxaaylIFIDdalkdbYI5hNec0W5iTvxkkLsdG3rIuOXZNIqtmbwg==',key_name='tempest-keypair-1653270261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-8sdto70b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=b1f798a4-a09c-4a10-ba68-650b7c757f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG os_vif [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacc0dfcd-a7, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapacc0dfcd-a7, col_values=(('external_ids', {'iface-id': 'acc0dfcd-a792-461b-890b-47ad7a7ca1e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:da:20', 'vm-uuid': 'b1f798a4-a09c-4a10-ba68-650b7c757f7f'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-0ff1926b-e6bc-4142-9775-7218b8eca027 req-2504aef5-90de-4cc0-b5a0-b0132ba87693 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0ff1926b-e6bc-4142-9775-7218b8eca027 req-2504aef5-90de-4cc0-b5a0-b0132ba87693 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0ff1926b-e6bc-4142-9775-7218b8eca027 req-2504aef5-90de-4cc0-b5a0-b0132ba87693 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0ff1926b-e6bc-4142-9775-7218b8eca027 req-2504aef5-90de-4cc0-b5a0-b0132ba87693 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-0ff1926b-e6bc-4142-9775-7218b8eca027 req-2504aef5-90de-4cc0-b5a0-b0132ba87693 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:28:53 user nova-compute[73627]: WARNING nova.compute.manager [req-0ff1926b-e6bc-4142-9775-7218b8eca027 req-2504aef5-90de-4cc0-b5a0-b0132ba87693 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state active and task_state powering-off.
Aug 26 16:28:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:53 user nova-compute[73627]: INFO os_vif [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7')
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] No VIF found with MAC fa:16:3e:10:da:20, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.network.neutron [req-9f401b92-dc03-4fc1-8d6c-c23d62e06a53 req-0cfe5f87-f1d7-4d17-a0bb-0dbd4bd20c9e service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updated VIF entry in instance network info cache for port acc0dfcd-a792-461b-890b-47ad7a7ca1e4. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG nova.network.neutron [req-9f401b92-dc03-4fc1-8d6c-c23d62e06a53 req-0cfe5f87-f1d7-4d17-a0bb-0dbd4bd20c9e service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updating instance_info_cache with network_info: [{"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:28:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9f401b92-dc03-4fc1-8d6c-c23d62e06a53 req-0cfe5f87-f1d7-4d17-a0bb-0dbd4bd20c9e service nova] Releasing lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:28:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] COPY block job progress, current cursor: 24051712 final cursor: 75497472 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:28:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:28:54 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 16:28:54 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance destroyed successfully.
Aug 26 16:28:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b0d3760d-1fe9-481d-b90c-57a1306035d9 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:28:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b0d3760d-1fe9-481d-b90c-57a1306035d9 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.320s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:55 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:28:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9ckiyhia/b243daab3e5948d380324d5a35f707ed.delta /opt/stack/data/nova/instances/snapshots/tmp9ckiyhia/b243daab3e5948d380324d5a35f707ed {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-cc9b31ac-e9a3-48a0-822a-fc40f218e1d8 req-55984fea-3c49-40a8-b118-b58c6b67f044 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cc9b31ac-e9a3-48a0-822a-fc40f218e1d8 req-55984fea-3c49-40a8-b118-b58c6b67f044 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cc9b31ac-e9a3-48a0-822a-fc40f218e1d8 req-55984fea-3c49-40a8-b118-b58c6b67f044 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cc9b31ac-e9a3-48a0-822a-fc40f218e1d8 req-55984fea-3c49-40a8-b118-b58c6b67f044 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-cc9b31ac-e9a3-48a0-822a-fc40f218e1d8 req-55984fea-3c49-40a8-b118-b58c6b67f044 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:28:55 user nova-compute[73627]: WARNING nova.compute.manager [req-cc9b31ac-e9a3-48a0-822a-fc40f218e1d8 req-55984fea-3c49-40a8-b118-b58c6b67f044 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state stopped and task_state None.
Aug 26 16:28:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9ckiyhia/b243daab3e5948d380324d5a35f707ed.delta /opt/stack/data/nova/instances/snapshots/tmp9ckiyhia/b243daab3e5948d380324d5a35f707ed" returned: 0 in 1.170s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:56 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Snapshot extracted, beginning image upload
Aug 26 16:28:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:28:57 user nova-compute[73627]: WARNING nova.compute.manager [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received unexpected event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with vm_state building and task_state spawning.
Aug 26 16:28:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:28:57 user nova-compute[73627]: WARNING nova.compute.manager [req-1f132bc2-5ceb-4d06-8c45-6a94deaa5ae5 req-80e29320-368e-4a1b-88eb-2bae99c0e1cc service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received unexpected event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with vm_state building and task_state spawning.
Aug 26 16:28:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:28:57 user nova-compute[73627]: INFO nova.compute.claims [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Claim successful on node user
Aug 26 16:28:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.853s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:28:58 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067338.5929158, b1f798a4-a09c-4a10-ba68-650b7c757f7f => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:28:58 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] VM Resumed (Lifecycle Event)
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:28:58 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Instance spawned successfully.
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:28:58 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067338.594281, b1f798a4-a09c-4a10-ba68-650b7c757f7f => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:28:58 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] VM Started (Lifecycle Event)
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.policy [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a886201ea8f4f49a7ad9a4ce5d96e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8293bcf7a5574394925ca3cf956f0b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:28:58 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:28:58 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Creating image(s)
Aug 26 16:28:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "/opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "/opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "/opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:58 user nova-compute[73627]: INFO nova.compute.manager [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Took 9.39 seconds to spawn the instance on the hypervisor.
Aug 26 16:28:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:28:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:58 user nova-compute[73627]: INFO nova.compute.manager [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Took 10.40 seconds to build instance.
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.292s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4f393572-0baf-4e16-a077-556cba32c9f3 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.635s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.195s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk 1073741824" returned: 0 in 0.056s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.234s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Successfully created port: f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Cannot resize image /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Ensure instance console log exists: /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:28:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:28:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Snapshot image upload complete
Aug 26 16:28:59 user nova-compute[73627]: INFO nova.compute.manager [None req-7337c906-9f72-4fc0-b162-7ed8ce07f599 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Took 8.36 seconds to snapshot the instance on the hypervisor.
Aug 26 16:29:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Successfully updated port: f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:29:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "refresh_cache-c437818f-4799-4ad9-8463-f798c768cae9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:29:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquired lock "refresh_cache-c437818f-4799-4ad9-8463-f798c768cae9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:29:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:29:00 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-e4ee243f-221a-44e9-9f42-f052d6b76def req-0bd40d6e-894f-45ac-9892-18f5e5c60d53 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Received event network-changed-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-e4ee243f-221a-44e9-9f42-f052d6b76def req-0bd40d6e-894f-45ac-9892-18f5e5c60d53 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Refreshing instance network info cache due to event network-changed-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:29:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e4ee243f-221a-44e9-9f42-f052d6b76def req-0bd40d6e-894f-45ac-9892-18f5e5c60d53 service nova] Acquiring lock "refresh_cache-c437818f-4799-4ad9-8463-f798c768cae9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:29:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Updating instance_info_cache with network_info: [{"id": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "address": "fa:16:3e:c4:29:2c", "network": {"id": "332616a2-e157-4895-aae0-b62458e95855", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1228136515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8293bcf7a5574394925ca3cf956f0b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf080d0ea-ed", "ovs_interfaceid": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Releasing lock "refresh_cache-c437818f-4799-4ad9-8463-f798c768cae9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Instance network_info: |[{"id": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "address": "fa:16:3e:c4:29:2c", "network": {"id": "332616a2-e157-4895-aae0-b62458e95855", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1228136515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8293bcf7a5574394925ca3cf956f0b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf080d0ea-ed", "ovs_interfaceid": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e4ee243f-221a-44e9-9f42-f052d6b76def req-0bd40d6e-894f-45ac-9892-18f5e5c60d53 service nova] Acquired lock "refresh_cache-c437818f-4799-4ad9-8463-f798c768cae9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-e4ee243f-221a-44e9-9f42-f052d6b76def req-0bd40d6e-894f-45ac-9892-18f5e5c60d53 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Refreshing network info cache for port f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Start _get_guest_xml network_info=[{"id": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "address": "fa:16:3e:c4:29:2c", "network": {"id": "332616a2-e157-4895-aae0-b62458e95855", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1228136515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8293bcf7a5574394925ca3cf956f0b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf080d0ea-ed", "ovs_interfaceid": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:29:01 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:29:01 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-473756470',display_name='tempest-TestVolumeSwap-server-473756470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-473756470',id=21,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6ogYs059BmYfaPDY/nm3JFFULOAbW8sqBs+XFUzElYr2bLklYtxdJr6Zj/r5TDimIpsLf+TcIq4FNT7sMB1JHTr3bu7oSpsem8G109oILgDzIPymoZHEgcC/s5SYY2iA==',key_name='tempest-keypair-1056555196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8293bcf7a5574394925ca3cf956f0b77',ramdisk_id='',reservation_id='r-fpfnm8a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2084039538',owner_user_name='tempest-TestVolumeSwap-2084039538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:28:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a886201ea8f4f49a7ad9a4ce5d96e94',uuid=c437818f-4799-4ad9-8463-f798c768cae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "address": "fa:16:3e:c4:29:2c", "network": {"id": "332616a2-e157-4895-aae0-b62458e95855", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1228136515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8293bcf7a5574394925ca3cf956f0b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf080d0ea-ed", "ovs_interfaceid": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Converting VIF {"id": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "address": "fa:16:3e:c4:29:2c", "network": {"id": "332616a2-e157-4895-aae0-b62458e95855", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1228136515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8293bcf7a5574394925ca3cf956f0b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf080d0ea-ed", "ovs_interfaceid": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:2c,bridge_name='br-int',has_traffic_filtering=True,id=f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76,network=Network(332616a2-e157-4895-aae0-b62458e95855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf080d0ea-ed') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.objects.instance [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lazy-loading 'pci_devices' on Instance uuid c437818f-4799-4ad9-8463-f798c768cae9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:29:01 user nova-compute[73627]:   <uuid>c437818f-4799-4ad9-8463-f798c768cae9</uuid>
Aug 26 16:29:01 user nova-compute[73627]:   <name>instance-00000015</name>
Aug 26 16:29:01 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:29:01 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:29:01 user nova-compute[73627]:   <metadata>
Aug 26 16:29:01 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:29:01 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:29:01 user nova-compute[73627]:       <nova:name>tempest-TestVolumeSwap-server-473756470</nova:name>
Aug 26 16:29:01 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:29:01</nova:creationTime>
Aug 26 16:29:01 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:29:01 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:29:01 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:29:01 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:29:01 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:29:01 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:29:01 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:29:01 user nova-compute[73627]:       <nova:owner>
Aug 26 16:29:01 user nova-compute[73627]:         <nova:user uuid="3a886201ea8f4f49a7ad9a4ce5d96e94">tempest-TestVolumeSwap-2084039538-project-member</nova:user>
Aug 26 16:29:01 user nova-compute[73627]:         <nova:project uuid="8293bcf7a5574394925ca3cf956f0b77">tempest-TestVolumeSwap-2084039538</nova:project>
Aug 26 16:29:01 user nova-compute[73627]:       </nova:owner>
Aug 26 16:29:01 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:29:01 user nova-compute[73627]:       <nova:ports>
Aug 26 16:29:01 user nova-compute[73627]:         <nova:port uuid="f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76">
Aug 26 16:29:01 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 16:29:01 user nova-compute[73627]:         </nova:port>
Aug 26 16:29:01 user nova-compute[73627]:       </nova:ports>
Aug 26 16:29:01 user nova-compute[73627]:     </nova:instance>
Aug 26 16:29:01 user nova-compute[73627]:   </metadata>
Aug 26 16:29:01 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:29:01 user nova-compute[73627]:     <system>
Aug 26 16:29:01 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:29:01 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:29:01 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:29:01 user nova-compute[73627]:       <entry name="serial">c437818f-4799-4ad9-8463-f798c768cae9</entry>
Aug 26 16:29:01 user nova-compute[73627]:       <entry name="uuid">c437818f-4799-4ad9-8463-f798c768cae9</entry>
Aug 26 16:29:01 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:29:01 user nova-compute[73627]:     </system>
Aug 26 16:29:01 user nova-compute[73627]:   </sysinfo>
Aug 26 16:29:01 user nova-compute[73627]:   <os>
Aug 26 16:29:01 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:29:01 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:29:01 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:29:01 user nova-compute[73627]:   </os>
Aug 26 16:29:01 user nova-compute[73627]:   <features>
Aug 26 16:29:01 user nova-compute[73627]:     <acpi/>
Aug 26 16:29:01 user nova-compute[73627]:     <apic/>
Aug 26 16:29:01 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:29:01 user nova-compute[73627]:   </features>
Aug 26 16:29:01 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:29:01 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:29:01 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:29:01 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:29:01 user nova-compute[73627]:   </clock>
Aug 26 16:29:01 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:29:01 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:29:01 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:29:01 user nova-compute[73627]:   </cpu>
Aug 26 16:29:01 user nova-compute[73627]:   <devices>
Aug 26 16:29:01 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:29:01 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:29:01 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk"/>
Aug 26 16:29:01 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:29:01 user nova-compute[73627]:     </disk>
Aug 26 16:29:01 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:29:01 user nova-compute[73627]:       <mac address="fa:16:3e:c4:29:2c"/>
Aug 26 16:29:01 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:29:01 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:29:01 user nova-compute[73627]:       <target dev="tapf080d0ea-ed"/>
Aug 26 16:29:01 user nova-compute[73627]:     </interface>
Aug 26 16:29:01 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:29:01 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/console.log" append="off"/>
Aug 26 16:29:01 user nova-compute[73627]:     </serial>
Aug 26 16:29:01 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:29:01 user nova-compute[73627]:     <video>
Aug 26 16:29:01 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:29:01 user nova-compute[73627]:     </video>
Aug 26 16:29:01 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:29:01 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:29:01 user nova-compute[73627]:     </rng>
Aug 26 16:29:01 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:29:01 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:29:01 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:29:01 user nova-compute[73627]:     </memballoon>
Aug 26 16:29:01 user nova-compute[73627]:   </devices>
Aug 26 16:29:01 user nova-compute[73627]: </domain>
Aug 26 16:29:01 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-473756470',display_name='tempest-TestVolumeSwap-server-473756470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-473756470',id=21,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6ogYs059BmYfaPDY/nm3JFFULOAbW8sqBs+XFUzElYr2bLklYtxdJr6Zj/r5TDimIpsLf+TcIq4FNT7sMB1JHTr3bu7oSpsem8G109oILgDzIPymoZHEgcC/s5SYY2iA==',key_name='tempest-keypair-1056555196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8293bcf7a5574394925ca3cf956f0b77',ramdisk_id='',reservation_id='r-fpfnm8a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2084039538',owner_user_name='tempest-TestVolumeSwap-2084039538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:28:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a886201ea8f4f49a7ad9a4ce5d96e94',uuid=c437818f-4799-4ad9-8463-f798c768cae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "address": "fa:16:3e:c4:29:2c", "network": {"id": "332616a2-e157-4895-aae0-b62458e95855", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1228136515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8293bcf7a5574394925ca3cf956f0b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf080d0ea-ed", "ovs_interfaceid": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Converting VIF {"id": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "address": "fa:16:3e:c4:29:2c", "network": {"id": "332616a2-e157-4895-aae0-b62458e95855", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1228136515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8293bcf7a5574394925ca3cf956f0b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf080d0ea-ed", "ovs_interfaceid": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:2c,bridge_name='br-int',has_traffic_filtering=True,id=f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76,network=Network(332616a2-e157-4895-aae0-b62458e95855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf080d0ea-ed') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG os_vif [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:2c,bridge_name='br-int',has_traffic_filtering=True,id=f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76,network=Network(332616a2-e157-4895-aae0-b62458e95855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf080d0ea-ed') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf080d0ea-ed, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf080d0ea-ed, col_values=(('external_ids', {'iface-id': 'f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:29:2c', 'vm-uuid': 'c437818f-4799-4ad9-8463-f798c768cae9'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:01 user nova-compute[73627]: INFO os_vif [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:2c,bridge_name='br-int',has_traffic_filtering=True,id=f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76,network=Network(332616a2-e157-4895-aae0-b62458e95855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf080d0ea-ed')
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] No VIF found with MAC fa:16:3e:c4:29:2c, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-e4ee243f-221a-44e9-9f42-f052d6b76def req-0bd40d6e-894f-45ac-9892-18f5e5c60d53 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Updated VIF entry in instance network info cache for port f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-e4ee243f-221a-44e9-9f42-f052d6b76def req-0bd40d6e-894f-45ac-9892-18f5e5c60d53 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Updating instance_info_cache with network_info: [{"id": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "address": "fa:16:3e:c4:29:2c", "network": {"id": "332616a2-e157-4895-aae0-b62458e95855", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1228136515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8293bcf7a5574394925ca3cf956f0b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf080d0ea-ed", "ovs_interfaceid": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e4ee243f-221a-44e9-9f42-f052d6b76def req-0bd40d6e-894f-45ac-9892-18f5e5c60d53 service nova] Releasing lock "refresh_cache-c437818f-4799-4ad9-8463-f798c768cae9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:29:02 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:02 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:29:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:03 user nova-compute[73627]: DEBUG nova.compute.manager [req-f65cdabc-73ce-4f1a-ab8f-4b8a4126319d req-b06cb4c6-7e49-462b-b866-ec073761ee46 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Received event network-vif-plugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f65cdabc-73ce-4f1a-ab8f-4b8a4126319d req-b06cb4c6-7e49-462b-b866-ec073761ee46 service nova] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f65cdabc-73ce-4f1a-ab8f-4b8a4126319d req-b06cb4c6-7e49-462b-b866-ec073761ee46 service nova] Lock "c437818f-4799-4ad9-8463-f798c768cae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f65cdabc-73ce-4f1a-ab8f-4b8a4126319d req-b06cb4c6-7e49-462b-b866-ec073761ee46 service nova] Lock "c437818f-4799-4ad9-8463-f798c768cae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:03 user nova-compute[73627]: DEBUG nova.compute.manager [req-f65cdabc-73ce-4f1a-ab8f-4b8a4126319d req-b06cb4c6-7e49-462b-b866-ec073761ee46 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] No waiting events found dispatching network-vif-plugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:03 user nova-compute[73627]: WARNING nova.compute.manager [req-f65cdabc-73ce-4f1a-ab8f-4b8a4126319d req-b06cb4c6-7e49-462b-b866-ec073761ee46 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Received unexpected event network-vif-plugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 for instance with vm_state building and task_state spawning.
Aug 26 16:29:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.357s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-8f425f62-85f2-4069-9974-fcbac257459a req-41d964de-7b0f-4f64-baba-0e13259ba9d7 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Received event network-vif-plugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8f425f62-85f2-4069-9974-fcbac257459a req-41d964de-7b0f-4f64-baba-0e13259ba9d7 service nova] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8f425f62-85f2-4069-9974-fcbac257459a req-41d964de-7b0f-4f64-baba-0e13259ba9d7 service nova] Lock "c437818f-4799-4ad9-8463-f798c768cae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8f425f62-85f2-4069-9974-fcbac257459a req-41d964de-7b0f-4f64-baba-0e13259ba9d7 service nova] Lock "c437818f-4799-4ad9-8463-f798c768cae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-8f425f62-85f2-4069-9974-fcbac257459a req-41d964de-7b0f-4f64-baba-0e13259ba9d7 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] No waiting events found dispatching network-vif-plugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:05 user nova-compute[73627]: WARNING nova.compute.manager [req-8f425f62-85f2-4069-9974-fcbac257459a req-41d964de-7b0f-4f64-baba-0e13259ba9d7 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Received unexpected event network-vif-plugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 for instance with vm_state building and task_state spawning.
Aug 26 16:29:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067345.9101512, c437818f-4799-4ad9-8463-f798c768cae9 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:05 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c437818f-4799-4ad9-8463-f798c768cae9] VM Resumed (Lifecycle Event)
Aug 26 16:29:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Instance spawned successfully.
Aug 26 16:29:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:29:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c437818f-4799-4ad9-8463-f798c768cae9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:29:06 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067345.910911, c437818f-4799-4ad9-8463-f798c768cae9 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c437818f-4799-4ad9-8463-f798c768cae9] VM Started (Lifecycle Event)
Aug 26 16:29:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:29:06 user nova-compute[73627]: INFO nova.compute.manager [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Took 7.35 seconds to spawn the instance on the hypervisor.
Aug 26 16:29:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c437818f-4799-4ad9-8463-f798c768cae9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:29:06 user nova-compute[73627]: INFO nova.compute.manager [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Took 8.64 seconds to build instance.
Aug 26 16:29:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cf4b55d7-2811-4424-9bcc-f77c1527134d tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.952s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:29:09 user nova-compute[73627]: INFO nova.compute.claims [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Claim successful on node user
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067334.6802015, 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:09 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] VM Stopped (Lifecycle Event)
Aug 26 16:29:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-3cb5b2e6-e670-4835-b33e-0a0ab6bf13bb None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-3cb5b2e6-e670-4835-b33e-0a0ab6bf13bb None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Refreshing inventories for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Updating ProviderTree inventory for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Updating inventory in ProviderTree for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Refreshing aggregate associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, aggregates: None {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:09 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Refreshing trait associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 16:29:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:10 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:29:10 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.515s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:29:11 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:29:11 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=7449MB free_disk=25.52910614013672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:29:11 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.policy [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '419538c7a200483689e0e419b34e1489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb420f29dc849efa3c0b2d28ab50813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a20c0a68-9781-4d6c-8f55-6952f1758f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de2d5475-ec56-47dc-aa29-8a3ff80e3f0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19c82f60-3294-4a09-96a3-b03a1673149c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b1f798a4-a09c-4a10-ba68-650b7c757f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c437818f-4799-4ad9-8463-f798c768cae9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 02728278-ff6a-41e3-b107-6e3106a56bc4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:29:11 user nova-compute[73627]: INFO nova.virt.block_device [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Booting with volume daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 at /dev/vda
Aug 26 16:29:11 user nova-compute[73627]: DEBUG os_brick.utils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e78790-5b65-41f9-97df-1a30e8d387a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0f2468-668d-405e-9281-8e9dce77a069]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4546553-98d7-47c9-9133-84396ee54926]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe5c3ce-3b67-4615-885f-ad7ce6bd1f89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:29:11 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[48346517-2d3f-4b62-82e9-d99f48af43e3]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG os_brick.utils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating existing volume attachment record: 4815fea0-ebcc-40f0-8efe-bec40f257fec {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.884s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 16:29:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] There are 0 instances to clean {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 16:29:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73627) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 16:29:13 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:13 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:13 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:29:13 user nova-compute[73627]: DEBUG nova.network.neutron [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Successfully created port: d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:29:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:29:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:29:13 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Updating instance_info_cache with network_info: [{"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG nova.network.neutron [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Successfully updated port: d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-19fcf882-d14e-4478-aed6-5e30db7d3e33" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquired lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG nova.network.neutron [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-3d812d91-da90-483b-874f-981987a5407a req-6931de2a-7781-48f9-accc-fb894b15ff5a service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-changed-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-3d812d91-da90-483b-874f-981987a5407a req-6931de2a-7781-48f9-accc-fb894b15ff5a service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Refreshing instance network info cache due to event network-changed-d43b5527-a43b-4a93-88fb-db830093b5ea. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3d812d91-da90-483b-874f-981987a5407a req-6931de2a-7781-48f9-accc-fb894b15ff5a service nova] Acquiring lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:29:14 user nova-compute[73627]: DEBUG nova.network.neutron [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:29:15 user nova-compute[73627]: WARNING nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 8164bb99-842e-49fc-8f36-093de455c311 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid a6f68ea4-789d-4456-a82d-d067384b566b {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 19fcf882-d14e-4478-aed6-5e30db7d3e33 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid a20c0a68-9781-4d6c-8f55-6952f1758f1f {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid de2d5475-ec56-47dc-aa29-8a3ff80e3f0d {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 19c82f60-3294-4a09-96a3-b03a1673149c {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid c437818f-4799-4ad9-8463-f798c768cae9 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 02728278-ff6a-41e3-b107-6e3106a56bc4 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "8164bb99-842e-49fc-8f36-093de455c311" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "8164bb99-842e-49fc-8f36-093de455c311" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "a6f68ea4-789d-4456-a82d-d067384b566b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "19c82f60-3294-4a09-96a3-b03a1673149c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "c437818f-4799-4ad9-8463-f798c768cae9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:15 user nova-compute[73627]: WARNING oslo_messaging._drivers.amqpdriver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "c437818f-4799-4ad9-8463-f798c768cae9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "8164bb99-842e-49fc-8f36-093de455c311" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating instance_info_cache with network_info: [{"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.161s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "a6f68ea4-789d-4456-a82d-d067384b566b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.174s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "19c82f60-3294-4a09-96a3-b03a1673149c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.179s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.189s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Releasing lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Instance network_info: |[{"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3d812d91-da90-483b-874f-981987a5407a req-6931de2a-7781-48f9-accc-fb894b15ff5a service nova] Acquired lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG nova.network.neutron [req-3d812d91-da90-483b-874f-981987a5407a req-6931de2a-7781-48f9-accc-fb894b15ff5a service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Refreshing network info cache for port d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:29:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:16 user nova-compute[73627]: DEBUG nova.network.neutron [req-3d812d91-da90-483b-874f-981987a5407a req-6931de2a-7781-48f9-accc-fb894b15ff5a service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updated VIF entry in instance network info cache for port d43b5527-a43b-4a93-88fb-db830093b5ea. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:29:16 user nova-compute[73627]: DEBUG nova.network.neutron [req-3d812d91-da90-483b-874f-981987a5407a req-6931de2a-7781-48f9-accc-fb894b15ff5a service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating instance_info_cache with network_info: [{"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3d812d91-da90-483b-874f-981987a5407a req-6931de2a-7781-48f9-accc-fb894b15ff5a service nova] Releasing lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:29:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:18 user nova-compute[73627]: INFO nova.compute.manager [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Terminating instance
Aug 26 16:29:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:29:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Instance destroyed successfully.
Aug 26 16:29:19 user nova-compute[73627]: DEBUG nova.objects.instance [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lazy-loading 'resources' on Instance uuid de2d5475-ec56-47dc-aa29-8a3ff80e3f0d {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-939752640',display_name='tempest-VolumesAdminNegativeTest-server-939752640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-939752640',id=18,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:27:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db772b720283431e97eb7ccbd346884d',ramdisk_id='',reservation_id='r-z436ocfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-8811083',owner_user_name='tempest-VolumesAdminNegativeTest-8811083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:27:16Z,user_data=None,user_id='46cb037a25de4d47b21fe34498409ad7',uuid=de2d5475-ec56-47dc-aa29-8a3ff80e3f0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "address": "fa:16:3e:10:64:0b", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdaadc9-aa", "ovs_interfaceid": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converting VIF {"id": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "address": "fa:16:3e:10:64:0b", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdaadc9-aa", "ovs_interfaceid": "8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdaadc9-aa') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG os_vif [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdaadc9-aa') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cdaadc9-aa, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:19 user nova-compute[73627]: INFO os_vif [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdaadc9-aa')
Aug 26 16:29:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Deleting instance files /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d_del
Aug 26 16:29:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Deletion of /opt/stack/data/nova/instances/de2d5475-ec56-47dc-aa29-8a3ff80e3f0d_del complete
Aug 26 16:29:19 user nova-compute[73627]: INFO nova.compute.manager [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 26 16:29:19 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:29:19 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:29:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-a73a6d15-17cb-405f-89e7-94c87f517b00 req-c3ac75b7-8a19-4448-82af-180df2eeda66 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Received event network-vif-unplugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a73a6d15-17cb-405f-89e7-94c87f517b00 req-c3ac75b7-8a19-4448-82af-180df2eeda66 service nova] Acquiring lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a73a6d15-17cb-405f-89e7-94c87f517b00 req-c3ac75b7-8a19-4448-82af-180df2eeda66 service nova] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a73a6d15-17cb-405f-89e7-94c87f517b00 req-c3ac75b7-8a19-4448-82af-180df2eeda66 service nova] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-a73a6d15-17cb-405f-89e7-94c87f517b00 req-c3ac75b7-8a19-4448-82af-180df2eeda66 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] No waiting events found dispatching network-vif-unplugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-a73a6d15-17cb-405f-89e7-94c87f517b00 req-c3ac75b7-8a19-4448-82af-180df2eeda66 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Received event network-vif-unplugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:29:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:21 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:21 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Took 1.64 seconds to deallocate network for instance.
Aug 26 16:29:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-69de940b-176c-4e13-ab4d-0314c88d592c req-48251589-94aa-4bca-b229-cb02d04c7c11 service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Received event network-vif-deleted-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:21 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:29:21 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:29:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:21 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Deleted allocations for instance de2d5475-ec56-47dc-aa29-8a3ff80e3f0d
Aug 26 16:29:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2cd57b54-2bb1-4bb9-9643-9e3ba2af56ef tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.120s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-4be0f3e0-0e4d-498b-a189-da2b7d79373d req-2fd0ecd0-6fba-472c-91ba-bf2dda93b31c service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Received event network-vif-plugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4be0f3e0-0e4d-498b-a189-da2b7d79373d req-2fd0ecd0-6fba-472c-91ba-bf2dda93b31c service nova] Acquiring lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4be0f3e0-0e4d-498b-a189-da2b7d79373d req-2fd0ecd0-6fba-472c-91ba-bf2dda93b31c service nova] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4be0f3e0-0e4d-498b-a189-da2b7d79373d req-2fd0ecd0-6fba-472c-91ba-bf2dda93b31c service nova] Lock "de2d5475-ec56-47dc-aa29-8a3ff80e3f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-4be0f3e0-0e4d-498b-a189-da2b7d79373d req-2fd0ecd0-6fba-472c-91ba-bf2dda93b31c service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] No waiting events found dispatching network-vif-plugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:22 user nova-compute[73627]: WARNING nova.compute.manager [req-4be0f3e0-0e4d-498b-a189-da2b7d79373d req-2fd0ecd0-6fba-472c-91ba-bf2dda93b31c service nova] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Received unexpected event network-vif-plugged-8cdaadc9-aaec-4a3b-8bd3-3dd9bbd25033 for instance with vm_state deleted and task_state None.
Aug 26 16:29:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:29:24 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Creating image(s)
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Ensure instance console log exists: /opt/stack/data/nova/instances/02728278-ff6a-41e3-b107-6e3106a56bc4/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Start _get_guest_xml network_info=[{"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLTItXHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02728278-ff6a-41e3-b107-6e3106a56bc4', 'attached_at': '', 'detached_at': '', 'volume_id': 'daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837', 'serial': 'daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837'}, 'guest_format': None, 'attachment_id': '4815fea0-ebcc-40f0-8efe-bec40f257fec', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:29:24 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:29:24 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLTItXHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:29:24 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:29:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:29:24 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:29:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:29:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:29:24 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:29:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cb26bd-7de9-4204-a05c-896947dc7606]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:29:25 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f8d85a-9a5a-4ead-9e74-c4899ca03be8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837] added
Aug 26 16:29:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ed50e6-652f-4730-87c3-621e5f9541ef]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9139a173-d396-429d-b080-808ab71442dd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLTItXHP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLTItXHP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac791a97-0100-438c-8625-4add692b69f7]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QLTItXHP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed7719c-3cec-45fc-bcd2-1f102840f1bd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedfc99a-952d-40d1-9248-bde2c5ac1396]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:29:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:29:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3cb77b-97d7-46e4-99cc-eead77068083]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260]
Aug 26 16:29:25 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260] successful.
Aug 26 16:29:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c89d60-854d-45ab-a6d9-c86446872b9b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1edc515-7518-4bc6-9b85-a4d80056057a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:29:25 user nova-compute[73627]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:29:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:29:25 user nova-compute[73627]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:29:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1e38d8-0bf2-4e88-9fd2-e210e9cbb5f4]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:25 user nova-compute[73627]: INFO nova.compute.manager [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Terminating instance
Aug 26 16:29:25 user nova-compute[73627]: DEBUG nova.compute.manager [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:29:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Instance destroyed successfully.
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.objects.instance [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'resources' on Instance uuid eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-168422289',display_name='tempest-AttachVolumeNegativeTest-server-168422289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-168422289',id=5,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTtrofWIbDkH09OMaX8ym0HDKfTOcV6N7I8fHHzHEv3eBxj6JlGPkmN8N5nJE3v0lSV2D4lAyo2ZhMVwgCHygQ1vCVqUhrrey2QM45upU76aSS8JKcqy6ooquNU411XwA==',key_name='tempest-keypair-1244461462',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:23:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-mzmsxl11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:23:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=eb7bd725-fdaa-46cf-aaa0-8430066c6fd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "address": "fa:16:3e:67:33:ba", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b47c648-ca", "ovs_interfaceid": "7b47c648-cab6-43bb-bae0-85a3690cb4ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:33:ba,bridge_name='br-int',has_traffic_filtering=True,id=7b47c648-cab6-43bb-bae0-85a3690cb4ea,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b47c648-ca') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG os_vif [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:33:ba,bridge_name='br-int',has_traffic_filtering=True,id=7b47c648-cab6-43bb-bae0-85a3690cb4ea,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b47c648-ca') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b47c648-ca, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:29:26 user nova-compute[73627]: INFO nova.compute.claims [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Claim successful on node user
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:26 user nova-compute[73627]: INFO os_vif [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:33:ba,bridge_name='br-int',has_traffic_filtering=True,id=7b47c648-cab6-43bb-bae0-85a3690cb4ea,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b47c648-ca')
Aug 26 16:29:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Deleting instance files /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3_del
Aug 26 16:29:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Deletion of /opt/stack/data/nova/instances/eb7bd725-fdaa-46cf-aaa0-8430066c6fd3_del complete
Aug 26 16:29:26 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLTItXHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23039613330653366', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039613330653366', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2043883167',display_name='tempest-TestShelveInstance-server-2043883167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2043883167',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUkKnXOk52N39dKNATbuSDCnmPHibOJEXSNpU+Lcz5ewHglXuNqvhgMoqWj5qUG6vl4G0GQ85lQIO6MbKAV4Di+T05lsQA5XzeIA/ENSR9D2OajBzjcbs97FcAoX/6G+w==',key_name='tempest-TestShelveInstance-1574199453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cb420f29dc849efa3c0b2d28ab50813',ramdisk_id='',reservation_id='r-uhsml3rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-562411929',owner_user_name='tempest-TestShelveInstance-562411929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:29:11Z,user_data=None,user_id='419538c7a200483689e0e419b34e1489',uuid=02728278-ff6a-41e3-b107-6e3106a56bc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converting VIF {"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.objects.instance [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lazy-loading 'pci_devices' on Instance uuid 02728278-ff6a-41e3-b107-6e3106a56bc4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:29:26 user nova-compute[73627]:   <uuid>02728278-ff6a-41e3-b107-6e3106a56bc4</uuid>
Aug 26 16:29:26 user nova-compute[73627]:   <name>instance-00000016</name>
Aug 26 16:29:26 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:29:26 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:29:26 user nova-compute[73627]:   <metadata>
Aug 26 16:29:26 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:29:26 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:29:26 user nova-compute[73627]:       <nova:name>tempest-TestShelveInstance-server-2043883167</nova:name>
Aug 26 16:29:26 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:29:24</nova:creationTime>
Aug 26 16:29:26 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:29:26 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:29:26 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:29:26 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:29:26 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:29:26 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:29:26 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:29:26 user nova-compute[73627]:       <nova:owner>
Aug 26 16:29:26 user nova-compute[73627]:         <nova:user uuid="419538c7a200483689e0e419b34e1489">tempest-TestShelveInstance-562411929-project-member</nova:user>
Aug 26 16:29:26 user nova-compute[73627]:         <nova:project uuid="2cb420f29dc849efa3c0b2d28ab50813">tempest-TestShelveInstance-562411929</nova:project>
Aug 26 16:29:26 user nova-compute[73627]:       </nova:owner>
Aug 26 16:29:26 user nova-compute[73627]:       <nova:ports>
Aug 26 16:29:26 user nova-compute[73627]:         <nova:port uuid="d43b5527-a43b-4a93-88fb-db830093b5ea">
Aug 26 16:29:26 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 16:29:26 user nova-compute[73627]:         </nova:port>
Aug 26 16:29:26 user nova-compute[73627]:       </nova:ports>
Aug 26 16:29:26 user nova-compute[73627]:     </nova:instance>
Aug 26 16:29:26 user nova-compute[73627]:   </metadata>
Aug 26 16:29:26 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:29:26 user nova-compute[73627]:     <system>
Aug 26 16:29:26 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:29:26 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:29:26 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:29:26 user nova-compute[73627]:       <entry name="serial">02728278-ff6a-41e3-b107-6e3106a56bc4</entry>
Aug 26 16:29:26 user nova-compute[73627]:       <entry name="uuid">02728278-ff6a-41e3-b107-6e3106a56bc4</entry>
Aug 26 16:29:26 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:29:26 user nova-compute[73627]:     </system>
Aug 26 16:29:26 user nova-compute[73627]:   </sysinfo>
Aug 26 16:29:26 user nova-compute[73627]:   <os>
Aug 26 16:29:26 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:29:26 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:29:26 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:29:26 user nova-compute[73627]:   </os>
Aug 26 16:29:26 user nova-compute[73627]:   <features>
Aug 26 16:29:26 user nova-compute[73627]:     <acpi/>
Aug 26 16:29:26 user nova-compute[73627]:     <apic/>
Aug 26 16:29:26 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:29:26 user nova-compute[73627]:   </features>
Aug 26 16:29:26 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:29:26 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:29:26 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:29:26 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:29:26 user nova-compute[73627]:   </clock>
Aug 26 16:29:26 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:29:26 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:29:26 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:29:26 user nova-compute[73627]:   </cpu>
Aug 26 16:29:26 user nova-compute[73627]:   <devices>
Aug 26 16:29:26 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:29:26 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:29:26 user nova-compute[73627]:       <source dev="/dev/sdc"/>
Aug 26 16:29:26 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:29:26 user nova-compute[73627]:       <serial>daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837</serial>
Aug 26 16:29:26 user nova-compute[73627]:     </disk>
Aug 26 16:29:26 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:29:26 user nova-compute[73627]:       <mac address="fa:16:3e:db:2d:8b"/>
Aug 26 16:29:26 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:29:26 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:29:26 user nova-compute[73627]:       <target dev="tapd43b5527-a4"/>
Aug 26 16:29:26 user nova-compute[73627]:     </interface>
Aug 26 16:29:26 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:29:26 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/02728278-ff6a-41e3-b107-6e3106a56bc4/console.log" append="off"/>
Aug 26 16:29:26 user nova-compute[73627]:     </serial>
Aug 26 16:29:26 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:29:26 user nova-compute[73627]:     <video>
Aug 26 16:29:26 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:29:26 user nova-compute[73627]:     </video>
Aug 26 16:29:26 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:29:26 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:29:26 user nova-compute[73627]:     </rng>
Aug 26 16:29:26 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:29:26 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:29:26 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:29:26 user nova-compute[73627]:     </memballoon>
Aug 26 16:29:26 user nova-compute[73627]:   </devices>
Aug 26 16:29:26 user nova-compute[73627]: </domain>
Aug 26 16:29:26 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2043883167',display_name='tempest-TestShelveInstance-server-2043883167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2043883167',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUkKnXOk52N39dKNATbuSDCnmPHibOJEXSNpU+Lcz5ewHglXuNqvhgMoqWj5qUG6vl4G0GQ85lQIO6MbKAV4Di+T05lsQA5XzeIA/ENSR9D2OajBzjcbs97FcAoX/6G+w==',key_name='tempest-TestShelveInstance-1574199453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cb420f29dc849efa3c0b2d28ab50813',ramdisk_id='',reservation_id='r-uhsml3rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-562411929',owner_user_name='tempest-TestShelveInstance-562411929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:29:11Z,user_data=None,user_id='419538c7a200483689e0e419b34e1489',uuid=02728278-ff6a-41e3-b107-6e3106a56bc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converting VIF {"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG os_vif [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:29:26 user nova-compute[73627]: INFO nova.compute.manager [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 16:29:26 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd43b5527-a4, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd43b5527-a4, col_values=(('external_ids', {'iface-id': 'd43b5527-a43b-4a93-88fb-db830093b5ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:2d:8b', 'vm-uuid': '02728278-ff6a-41e3-b107-6e3106a56bc4'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:26 user nova-compute[73627]: INFO os_vif [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4')
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] No VIF found with MAC fa:16:3e:db:2d:8b, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.725s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:29:27 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:29:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:29:27 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Creating image(s)
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "/opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "/opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "/opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG nova.policy [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39741061f0a042a98ab5157d648683a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170fc5b72aa94714abaa09b77791cae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk 1073741824" returned: 0 in 0.053s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:27 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Took 1.52 seconds to deallocate network for instance.
Aug 26 16:29:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5db9067b-384c-4655-8334-1fdd7fc5bff9 req-b8a6dd24-733f-478f-9438-6ab0c34870f5 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Received event network-vif-deleted-7b47c648-cab6-43bb-bae0-85a3690cb4ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:27 user nova-compute[73627]: INFO nova.compute.manager [req-5db9067b-384c-4655-8334-1fdd7fc5bff9 req-b8a6dd24-733f-478f-9438-6ab0c34870f5 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Neutron deleted interface 7b47c648-cab6-43bb-bae0-85a3690cb4ea; detaching it from the instance and deleting it from the info cache
Aug 26 16:29:27 user nova-compute[73627]: DEBUG nova.network.neutron [req-5db9067b-384c-4655-8334-1fdd7fc5bff9 req-b8a6dd24-733f-478f-9438-6ab0c34870f5 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.229s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-5db9067b-384c-4655-8334-1fdd7fc5bff9 req-b8a6dd24-733f-478f-9438-6ab0c34870f5 service nova] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Detach interface failed, port_id=7b47c648-cab6-43bb-bae0-85a3690cb4ea, reason: Instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-f85923a1-8405-4167-81c4-3e827c85536d req-7c5c2e49-fd18-4ce4-b6a0-21a0d1715f3f service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f85923a1-8405-4167-81c4-3e827c85536d req-7c5c2e49-fd18-4ce4-b6a0-21a0d1715f3f service nova] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f85923a1-8405-4167-81c4-3e827c85536d req-7c5c2e49-fd18-4ce4-b6a0-21a0d1715f3f service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f85923a1-8405-4167-81c4-3e827c85536d req-7c5c2e49-fd18-4ce4-b6a0-21a0d1715f3f service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-f85923a1-8405-4167-81c4-3e827c85536d req-7c5c2e49-fd18-4ce4-b6a0-21a0d1715f3f service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] No waiting events found dispatching network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:28 user nova-compute[73627]: WARNING nova.compute.manager [req-f85923a1-8405-4167-81c4-3e827c85536d req-7c5c2e49-fd18-4ce4-b6a0-21a0d1715f3f service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received unexpected event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea for instance with vm_state building and task_state spawning.
Aug 26 16:29:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Cannot resize image /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Ensure instance console log exists: /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:29:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.546s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:29 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Deleted allocations for instance eb7bd725-fdaa-46cf-aaa0-8430066c6fd3
Aug 26 16:29:29 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Successfully created port: 02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:29:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d530210b-40c5-4cbc-b9e3-51b8444b21dc tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "eb7bd725-fdaa-46cf-aaa0-8430066c6fd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.489s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.compute.manager [req-d5fb7a9f-d4a9-4a63-860b-3488d45b9107 req-6bd34905-e69d-464e-a93d-6c88100fc12e service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d5fb7a9f-d4a9-4a63-860b-3488d45b9107 req-6bd34905-e69d-464e-a93d-6c88100fc12e service nova] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d5fb7a9f-d4a9-4a63-860b-3488d45b9107 req-6bd34905-e69d-464e-a93d-6c88100fc12e service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d5fb7a9f-d4a9-4a63-860b-3488d45b9107 req-6bd34905-e69d-464e-a93d-6c88100fc12e service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.compute.manager [req-d5fb7a9f-d4a9-4a63-860b-3488d45b9107 req-6bd34905-e69d-464e-a93d-6c88100fc12e service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] No waiting events found dispatching network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:30 user nova-compute[73627]: WARNING nova.compute.manager [req-d5fb7a9f-d4a9-4a63-860b-3488d45b9107 req-6bd34905-e69d-464e-a93d-6c88100fc12e service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received unexpected event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea for instance with vm_state building and task_state spawning.
Aug 26 16:29:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067370.62595, 02728278-ff6a-41e3-b107-6e3106a56bc4 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:30 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] VM Resumed (Lifecycle Event)
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:29:30 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Instance spawned successfully.
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:30 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067370.6268253, 02728278-ff6a-41e3-b107-6e3106a56bc4 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:30 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] VM Started (Lifecycle Event)
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:29:30 user nova-compute[73627]: INFO nova.compute.manager [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:30 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Successfully updated port: 02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:29:30 user nova-compute[73627]: INFO nova.compute.manager [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Took 21.68 seconds to build instance.
Aug 26 16:29:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquired lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ab6223ef-cf28-4c58-b88a-52946c32f7e0 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.839s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.704s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:30 user nova-compute[73627]: INFO nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 26 16:29:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.compute.manager [req-901bd987-a578-49ee-91c4-3552b9e34f63 req-0bb3507e-c94f-4237-a429-225c7e050378 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-changed-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG nova.compute.manager [req-901bd987-a578-49ee-91c4-3552b9e34f63 req-0bb3507e-c94f-4237-a429-225c7e050378 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Refreshing instance network info cache due to event network-changed-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:29:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-901bd987-a578-49ee-91c4-3552b9e34f63 req-0bb3507e-c94f-4237-a429-225c7e050378 service nova] Acquiring lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updating instance_info_cache with network_info: [{"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Releasing lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Instance network_info: |[{"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-901bd987-a578-49ee-91c4-3552b9e34f63 req-0bb3507e-c94f-4237-a429-225c7e050378 service nova] Acquired lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.network.neutron [req-901bd987-a578-49ee-91c4-3552b9e34f63 req-0bb3507e-c94f-4237-a429-225c7e050378 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Refreshing network info cache for port 02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Start _get_guest_xml network_info=[{"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:29:31 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:29:31 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-39161320',display_name='tempest-ServerStableDeviceRescueTest-server-39161320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-39161320',id=23,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO64A3VuwOomVkMVVsLTAzcYE+ExmMEOo9bHneMgJKTrq9rsIIPhjn8kTeqDyPM4piz3MvWbnzDNLC6HZ6tFcdoM9wWYM8egwAGKQgjLwwTX7rRZor9Hr+bqZiVwfpWGkQ==',key_name='tempest-keypair-937707165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='170fc5b72aa94714abaa09b77791cae4',ramdisk_id='',reservation_id='r-szbnyb4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1226654466',owner_user_name='tempest-ServerStableDeviceRescueTest-1226654466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39741061f0a042a98ab5157d648683a4',uuid=d77a7aa1-4027-4036-b8e5-60f7fd05dfff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Converting VIF {"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=02c1f98d-e7ae-4afb-a56a-35cf0b0050ff,network=Network(d70def36-9f98-47bf-b769-2fc4dc16fe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c1f98d-e7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'pci_devices' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:29:31 user nova-compute[73627]:   <uuid>d77a7aa1-4027-4036-b8e5-60f7fd05dfff</uuid>
Aug 26 16:29:31 user nova-compute[73627]:   <name>instance-00000017</name>
Aug 26 16:29:31 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:29:31 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:29:31 user nova-compute[73627]:   <metadata>
Aug 26 16:29:31 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:29:31 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:29:31 user nova-compute[73627]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-39161320</nova:name>
Aug 26 16:29:31 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:29:31</nova:creationTime>
Aug 26 16:29:31 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:29:31 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:29:31 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:29:31 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:29:31 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:29:31 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:29:31 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:29:31 user nova-compute[73627]:       <nova:owner>
Aug 26 16:29:31 user nova-compute[73627]:         <nova:user uuid="39741061f0a042a98ab5157d648683a4">tempest-ServerStableDeviceRescueTest-1226654466-project-member</nova:user>
Aug 26 16:29:31 user nova-compute[73627]:         <nova:project uuid="170fc5b72aa94714abaa09b77791cae4">tempest-ServerStableDeviceRescueTest-1226654466</nova:project>
Aug 26 16:29:31 user nova-compute[73627]:       </nova:owner>
Aug 26 16:29:31 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:29:31 user nova-compute[73627]:       <nova:ports>
Aug 26 16:29:31 user nova-compute[73627]:         <nova:port uuid="02c1f98d-e7ae-4afb-a56a-35cf0b0050ff">
Aug 26 16:29:31 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 16:29:31 user nova-compute[73627]:         </nova:port>
Aug 26 16:29:31 user nova-compute[73627]:       </nova:ports>
Aug 26 16:29:31 user nova-compute[73627]:     </nova:instance>
Aug 26 16:29:31 user nova-compute[73627]:   </metadata>
Aug 26 16:29:31 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:29:31 user nova-compute[73627]:     <system>
Aug 26 16:29:31 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:29:31 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:29:31 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:29:31 user nova-compute[73627]:       <entry name="serial">d77a7aa1-4027-4036-b8e5-60f7fd05dfff</entry>
Aug 26 16:29:31 user nova-compute[73627]:       <entry name="uuid">d77a7aa1-4027-4036-b8e5-60f7fd05dfff</entry>
Aug 26 16:29:31 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:29:31 user nova-compute[73627]:     </system>
Aug 26 16:29:31 user nova-compute[73627]:   </sysinfo>
Aug 26 16:29:31 user nova-compute[73627]:   <os>
Aug 26 16:29:31 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:29:31 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:29:31 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:29:31 user nova-compute[73627]:   </os>
Aug 26 16:29:31 user nova-compute[73627]:   <features>
Aug 26 16:29:31 user nova-compute[73627]:     <acpi/>
Aug 26 16:29:31 user nova-compute[73627]:     <apic/>
Aug 26 16:29:31 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:29:31 user nova-compute[73627]:   </features>
Aug 26 16:29:31 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:29:31 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:29:31 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:29:31 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:29:31 user nova-compute[73627]:   </clock>
Aug 26 16:29:31 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:29:31 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:29:31 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:29:31 user nova-compute[73627]:   </cpu>
Aug 26 16:29:31 user nova-compute[73627]:   <devices>
Aug 26 16:29:31 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:29:31 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:29:31 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk"/>
Aug 26 16:29:31 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:29:31 user nova-compute[73627]:     </disk>
Aug 26 16:29:31 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:29:31 user nova-compute[73627]:       <mac address="fa:16:3e:65:3a:12"/>
Aug 26 16:29:31 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:29:31 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:29:31 user nova-compute[73627]:       <target dev="tap02c1f98d-e7"/>
Aug 26 16:29:31 user nova-compute[73627]:     </interface>
Aug 26 16:29:31 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:29:31 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/console.log" append="off"/>
Aug 26 16:29:31 user nova-compute[73627]:     </serial>
Aug 26 16:29:31 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:29:31 user nova-compute[73627]:     <video>
Aug 26 16:29:31 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:29:31 user nova-compute[73627]:     </video>
Aug 26 16:29:31 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:29:31 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:29:31 user nova-compute[73627]:     </rng>
Aug 26 16:29:31 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:29:31 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:29:31 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:29:31 user nova-compute[73627]:     </memballoon>
Aug 26 16:29:31 user nova-compute[73627]:   </devices>
Aug 26 16:29:31 user nova-compute[73627]: </domain>
Aug 26 16:29:31 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-39161320',display_name='tempest-ServerStableDeviceRescueTest-server-39161320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-39161320',id=23,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO64A3VuwOomVkMVVsLTAzcYE+ExmMEOo9bHneMgJKTrq9rsIIPhjn8kTeqDyPM4piz3MvWbnzDNLC6HZ6tFcdoM9wWYM8egwAGKQgjLwwTX7rRZor9Hr+bqZiVwfpWGkQ==',key_name='tempest-keypair-937707165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='170fc5b72aa94714abaa09b77791cae4',ramdisk_id='',reservation_id='r-szbnyb4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1226654466',owner_user_name='tempest-ServerStableDeviceRescueTest-1226654466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39741061f0a042a98ab5157d648683a4',uuid=d77a7aa1-4027-4036-b8e5-60f7fd05dfff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Converting VIF {"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=02c1f98d-e7ae-4afb-a56a-35cf0b0050ff,network=Network(d70def36-9f98-47bf-b769-2fc4dc16fe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c1f98d-e7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG os_vif [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=02c1f98d-e7ae-4afb-a56a-35cf0b0050ff,network=Network(d70def36-9f98-47bf-b769-2fc4dc16fe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c1f98d-e7') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02c1f98d-e7, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02c1f98d-e7, col_values=(('external_ids', {'iface-id': '02c1f98d-e7ae-4afb-a56a-35cf0b0050ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:3a:12', 'vm-uuid': 'd77a7aa1-4027-4036-b8e5-60f7fd05dfff'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:31 user nova-compute[73627]: INFO os_vif [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=02c1f98d-e7ae-4afb-a56a-35cf0b0050ff,network=Network(d70def36-9f98-47bf-b769-2fc4dc16fe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c1f98d-e7')
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:29:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] No VIF found with MAC fa:16:3e:65:3a:12, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:29:32 user nova-compute[73627]: DEBUG nova.compute.manager [req-36e288e3-4bd2-49a7-a23f-3e5f24d5a881 req-4a17aa78-5756-4641-87e3-a84752748900 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-changed-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:32 user nova-compute[73627]: DEBUG nova.compute.manager [req-36e288e3-4bd2-49a7-a23f-3e5f24d5a881 req-4a17aa78-5756-4641-87e3-a84752748900 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Refreshing instance network info cache due to event network-changed-ae911fbe-6ac5-4ef1-8224-47806a42627b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:29:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-36e288e3-4bd2-49a7-a23f-3e5f24d5a881 req-4a17aa78-5756-4641-87e3-a84752748900 service nova] Acquiring lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:29:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-36e288e3-4bd2-49a7-a23f-3e5f24d5a881 req-4a17aa78-5756-4641-87e3-a84752748900 service nova] Acquired lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:29:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-36e288e3-4bd2-49a7-a23f-3e5f24d5a881 req-4a17aa78-5756-4641-87e3-a84752748900 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Refreshing network info cache for port ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:29:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-901bd987-a578-49ee-91c4-3552b9e34f63 req-0bb3507e-c94f-4237-a429-225c7e050378 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updated VIF entry in instance network info cache for port 02c1f98d-e7ae-4afb-a56a-35cf0b0050ff. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:29:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-901bd987-a578-49ee-91c4-3552b9e34f63 req-0bb3507e-c94f-4237-a429-225c7e050378 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updating instance_info_cache with network_info: [{"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-901bd987-a578-49ee-91c4-3552b9e34f63 req-0bb3507e-c94f-4237-a429-225c7e050378 service nova] Releasing lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:29:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-36e288e3-4bd2-49a7-a23f-3e5f24d5a881 req-4a17aa78-5756-4641-87e3-a84752748900 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updated VIF entry in instance network info cache for port ae911fbe-6ac5-4ef1-8224-47806a42627b. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:29:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-36e288e3-4bd2-49a7-a23f-3e5f24d5a881 req-4a17aa78-5756-4641-87e3-a84752748900 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating instance_info_cache with network_info: [{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-36e288e3-4bd2-49a7-a23f-3e5f24d5a881 req-4a17aa78-5756-4641-87e3-a84752748900 service nova] Releasing lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:29:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:34 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067359.3360682, de2d5475-ec56-47dc-aa29-8a3ff80e3f0d => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:34 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] VM Stopped (Lifecycle Event)
Aug 26 16:29:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-d1adc00b-7591-4258-8755-29070283b6c4 None None] [instance: de2d5475-ec56-47dc-aa29-8a3ff80e3f0d] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067375.4628687, d77a7aa1-4027-4036-b8e5-60f7fd05dfff => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] VM Resumed (Lifecycle Event)
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:29:35 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Instance spawned successfully.
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:29:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067375.4652011, d77a7aa1-4027-4036-b8e5-60f7fd05dfff => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] VM Started (Lifecycle Event)
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:35 user nova-compute[73627]: INFO nova.compute.manager [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Took 8.31 seconds to spawn the instance on the hypervisor.
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:29:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:29:35 user nova-compute[73627]: INFO nova.compute.manager [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Took 9.42 seconds to build instance.
Aug 26 16:29:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8cb464d6-63f2-410d-9553-57a5f920b10d tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.528s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "c3901966-61e2-4be6-bb8f-bbc449c35b78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:29:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:29:36 user nova-compute[73627]: INFO nova.compute.claims [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Claim successful on node user
Aug 26 16:29:37 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG nova.network.neutron [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:29:37 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:29:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG nova.policy [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8945b1b1110e44568e0de86204d65e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8aed25a3184cf884a5774515d6d202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:29:37 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Creating image(s)
Aug 26 16:29:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "/opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "/opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.224s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk 1073741824" returned: 0 in 0.061s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Successfully created port: 9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Cannot resize image /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Ensure instance console log exists: /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-2fe1a3aa-c3af-46ed-976d-2bf703e35e3c req-2cacfc9c-0fe2-4083-a1a5-aa0dcab0ad2b service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2fe1a3aa-c3af-46ed-976d-2bf703e35e3c req-2cacfc9c-0fe2-4083-a1a5-aa0dcab0ad2b service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2fe1a3aa-c3af-46ed-976d-2bf703e35e3c req-2cacfc9c-0fe2-4083-a1a5-aa0dcab0ad2b service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2fe1a3aa-c3af-46ed-976d-2bf703e35e3c req-2cacfc9c-0fe2-4083-a1a5-aa0dcab0ad2b service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-2fe1a3aa-c3af-46ed-976d-2bf703e35e3c req-2cacfc9c-0fe2-4083-a1a5-aa0dcab0ad2b service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:38 user nova-compute[73627]: WARNING nova.compute.manager [req-2fe1a3aa-c3af-46ed-976d-2bf703e35e3c req-2cacfc9c-0fe2-4083-a1a5-aa0dcab0ad2b service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received unexpected event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with vm_state active and task_state None.
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.network.neutron [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Successfully updated port: 9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquired lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.network.neutron [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.network.neutron [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.network.neutron [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updating instance_info_cache with network_info: [{"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Releasing lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Instance network_info: |[{"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Start _get_guest_xml network_info=[{"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:29:39 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:29:39 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:29:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1925057988',display_name='tempest-ServerActionsTestOtherA-server-1925057988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1925057988',id=24,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPablajuq8xLBFiX0kjjyHTcUxoq8CZCKKmSQoF/n+RncsJGeKPTG3tFOgrEM0xDUb7dmLLfXVGvvH6d7PuXa2K1fYDVua5anrg1Gw7a6no9azLYSkiUBpYQ6yR/vuL6og==',key_name='tempest-keypair-1189535517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-gf260oy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=c3901966-61e2-4be6-bb8f-bbc449c35b78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=9c451176-da07-49b3-8a14-03f62ec16298,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c451176-da') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'pci_devices' on Instance uuid c3901966-61e2-4be6-bb8f-bbc449c35b78 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:29:39 user nova-compute[73627]:   <uuid>c3901966-61e2-4be6-bb8f-bbc449c35b78</uuid>
Aug 26 16:29:39 user nova-compute[73627]:   <name>instance-00000018</name>
Aug 26 16:29:39 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:29:39 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:29:39 user nova-compute[73627]:   <metadata>
Aug 26 16:29:39 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:29:39 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:29:39 user nova-compute[73627]:       <nova:name>tempest-ServerActionsTestOtherA-server-1925057988</nova:name>
Aug 26 16:29:39 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:29:39</nova:creationTime>
Aug 26 16:29:39 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:29:39 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:29:39 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:29:39 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:29:39 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:29:39 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:29:39 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:29:39 user nova-compute[73627]:       <nova:owner>
Aug 26 16:29:39 user nova-compute[73627]:         <nova:user uuid="8945b1b1110e44568e0de86204d65e34">tempest-ServerActionsTestOtherA-1664197223-project-member</nova:user>
Aug 26 16:29:39 user nova-compute[73627]:         <nova:project uuid="3f8aed25a3184cf884a5774515d6d202">tempest-ServerActionsTestOtherA-1664197223</nova:project>
Aug 26 16:29:39 user nova-compute[73627]:       </nova:owner>
Aug 26 16:29:39 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:29:39 user nova-compute[73627]:       <nova:ports>
Aug 26 16:29:39 user nova-compute[73627]:         <nova:port uuid="9c451176-da07-49b3-8a14-03f62ec16298">
Aug 26 16:29:39 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 16:29:39 user nova-compute[73627]:         </nova:port>
Aug 26 16:29:39 user nova-compute[73627]:       </nova:ports>
Aug 26 16:29:39 user nova-compute[73627]:     </nova:instance>
Aug 26 16:29:39 user nova-compute[73627]:   </metadata>
Aug 26 16:29:39 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:29:39 user nova-compute[73627]:     <system>
Aug 26 16:29:39 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:29:39 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:29:39 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:29:39 user nova-compute[73627]:       <entry name="serial">c3901966-61e2-4be6-bb8f-bbc449c35b78</entry>
Aug 26 16:29:39 user nova-compute[73627]:       <entry name="uuid">c3901966-61e2-4be6-bb8f-bbc449c35b78</entry>
Aug 26 16:29:39 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:29:39 user nova-compute[73627]:     </system>
Aug 26 16:29:39 user nova-compute[73627]:   </sysinfo>
Aug 26 16:29:39 user nova-compute[73627]:   <os>
Aug 26 16:29:39 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:29:39 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:29:39 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:29:39 user nova-compute[73627]:   </os>
Aug 26 16:29:39 user nova-compute[73627]:   <features>
Aug 26 16:29:39 user nova-compute[73627]:     <acpi/>
Aug 26 16:29:39 user nova-compute[73627]:     <apic/>
Aug 26 16:29:39 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:29:39 user nova-compute[73627]:   </features>
Aug 26 16:29:39 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:29:39 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:29:39 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:29:39 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:29:39 user nova-compute[73627]:   </clock>
Aug 26 16:29:39 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:29:39 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:29:39 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:29:39 user nova-compute[73627]:   </cpu>
Aug 26 16:29:39 user nova-compute[73627]:   <devices>
Aug 26 16:29:39 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:29:39 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:29:39 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk"/>
Aug 26 16:29:39 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:29:39 user nova-compute[73627]:     </disk>
Aug 26 16:29:39 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:29:39 user nova-compute[73627]:       <mac address="fa:16:3e:a1:e2:5d"/>
Aug 26 16:29:39 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:29:39 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:29:39 user nova-compute[73627]:       <target dev="tap9c451176-da"/>
Aug 26 16:29:39 user nova-compute[73627]:     </interface>
Aug 26 16:29:39 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:29:39 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/console.log" append="off"/>
Aug 26 16:29:39 user nova-compute[73627]:     </serial>
Aug 26 16:29:39 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:29:39 user nova-compute[73627]:     <video>
Aug 26 16:29:39 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:29:39 user nova-compute[73627]:     </video>
Aug 26 16:29:39 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:29:39 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:29:39 user nova-compute[73627]:     </rng>
Aug 26 16:29:39 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:29:39 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:29:39 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:29:39 user nova-compute[73627]:     </memballoon>
Aug 26 16:29:39 user nova-compute[73627]:   </devices>
Aug 26 16:29:39 user nova-compute[73627]: </domain>
Aug 26 16:29:39 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:29:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1925057988',display_name='tempest-ServerActionsTestOtherA-server-1925057988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1925057988',id=24,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPablajuq8xLBFiX0kjjyHTcUxoq8CZCKKmSQoF/n+RncsJGeKPTG3tFOgrEM0xDUb7dmLLfXVGvvH6d7PuXa2K1fYDVua5anrg1Gw7a6no9azLYSkiUBpYQ6yR/vuL6og==',key_name='tempest-keypair-1189535517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-gf260oy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=c3901966-61e2-4be6-bb8f-bbc449c35b78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=9c451176-da07-49b3-8a14-03f62ec16298,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c451176-da') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG os_vif [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=9c451176-da07-49b3-8a14-03f62ec16298,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c451176-da') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c451176-da, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c451176-da, col_values=(('external_ids', {'iface-id': '9c451176-da07-49b3-8a14-03f62ec16298', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:e2:5d', 'vm-uuid': 'c3901966-61e2-4be6-bb8f-bbc449c35b78'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:29:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:39 user nova-compute[73627]: INFO os_vif [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=9c451176-da07-49b3-8a14-03f62ec16298,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c451176-da')
Aug 26 16:29:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:29:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No VIF found with MAC fa:16:3e:a1:e2:5d, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:29:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:40 user nova-compute[73627]: WARNING nova.compute.manager [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received unexpected event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with vm_state active and task_state None.
Aug 26 16:29:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-changed-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Refreshing instance network info cache due to event network-changed-9c451176-da07-49b3-8a14-03f62ec16298. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:29:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] Acquiring lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:29:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] Acquired lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:29:40 user nova-compute[73627]: DEBUG nova.network.neutron [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Refreshing network info cache for port 9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067366.2510793, eb7bd725-fdaa-46cf-aaa0-8430066c6fd3 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:41 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] VM Stopped (Lifecycle Event)
Aug 26 16:29:41 user nova-compute[73627]: DEBUG nova.compute.manager [None req-df4b56d5-e195-48af-ab6e-29e2fd5dfc4f None None] [instance: eb7bd725-fdaa-46cf-aaa0-8430066c6fd3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG nova.network.neutron [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updated VIF entry in instance network info cache for port 9c451176-da07-49b3-8a14-03f62ec16298. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG nova.network.neutron [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updating instance_info_cache with network_info: [{"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f16f4900-d0b8-4484-95c9-b66a007a49a6 req-6f3be1fd-0f3d-4fec-91ed-0733ef4e0863 service nova] Releasing lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-9925c778-aecb-42d7-8684-b16aae535585 req-00deb233-f38f-46a1-b245-19902fd5feec service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9925c778-aecb-42d7-8684-b16aae535585 req-00deb233-f38f-46a1-b245-19902fd5feec service nova] Acquiring lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9925c778-aecb-42d7-8684-b16aae535585 req-00deb233-f38f-46a1-b245-19902fd5feec service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9925c778-aecb-42d7-8684-b16aae535585 req-00deb233-f38f-46a1-b245-19902fd5feec service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-9925c778-aecb-42d7-8684-b16aae535585 req-00deb233-f38f-46a1-b245-19902fd5feec service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] No waiting events found dispatching network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:41 user nova-compute[73627]: WARNING nova.compute.manager [req-9925c778-aecb-42d7-8684-b16aae535585 req-00deb233-f38f-46a1-b245-19902fd5feec service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received unexpected event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 for instance with vm_state building and task_state spawning.
Aug 26 16:29:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067383.6377075, c3901966-61e2-4be6-bb8f-bbc449c35b78 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] VM Resumed (Lifecycle Event)
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:29:43 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Instance spawned successfully.
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:29:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067383.6410902, c3901966-61e2-4be6-bb8f-bbc449c35b78 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] VM Started (Lifecycle Event)
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-e985d475-d349-472a-8895-b3ccb05f861e req-8f5bc7aa-fb16-4ec8-b054-da7de22e559d service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e985d475-d349-472a-8895-b3ccb05f861e req-8f5bc7aa-fb16-4ec8-b054-da7de22e559d service nova] Acquiring lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e985d475-d349-472a-8895-b3ccb05f861e req-8f5bc7aa-fb16-4ec8-b054-da7de22e559d service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e985d475-d349-472a-8895-b3ccb05f861e req-8f5bc7aa-fb16-4ec8-b054-da7de22e559d service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-e985d475-d349-472a-8895-b3ccb05f861e req-8f5bc7aa-fb16-4ec8-b054-da7de22e559d service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] No waiting events found dispatching network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:43 user nova-compute[73627]: WARNING nova.compute.manager [req-e985d475-d349-472a-8895-b3ccb05f861e req-8f5bc7aa-fb16-4ec8-b054-da7de22e559d service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received unexpected event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 for instance with vm_state building and task_state spawning.
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:43 user nova-compute[73627]: INFO nova.compute.manager [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Took 6.22 seconds to spawn the instance on the hypervisor.
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:29:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:29:43 user nova-compute[73627]: INFO nova.compute.manager [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Took 7.11 seconds to build instance.
Aug 26 16:29:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7deabc89-3851-4994-b393-f0f79c2489d9 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.207s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:48 user nova-compute[73627]: INFO nova.compute.manager [None req-5713dc60-6ac4-4ef6-875a-bb93461ca128 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Unrescuing
Aug 26 16:29:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5713dc60-6ac4-4ef6-875a-bb93461ca128 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:29:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5713dc60-6ac4-4ef6-875a-bb93461ca128 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquired lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:29:48 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5713dc60-6ac4-4ef6-875a-bb93461ca128 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5713dc60-6ac4-4ef6-875a-bb93461ca128 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updating instance_info_cache with network_info: [{"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5713dc60-6ac4-4ef6-875a-bb93461ca128 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Releasing lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG nova.objects.instance [None req-5713dc60-6ac4-4ef6-875a-bb93461ca128 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'flavor' on Instance uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-b6379f55-83f5-4454-a265-111163392378 req-ec3d6a2d-9ce7-4990-8e5e-5b620a659e95 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-unplugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6379f55-83f5-4454-a265-111163392378 req-ec3d6a2d-9ce7-4990-8e5e-5b620a659e95 service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6379f55-83f5-4454-a265-111163392378 req-ec3d6a2d-9ce7-4990-8e5e-5b620a659e95 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6379f55-83f5-4454-a265-111163392378 req-ec3d6a2d-9ce7-4990-8e5e-5b620a659e95 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-b6379f55-83f5-4454-a265-111163392378 req-ec3d6a2d-9ce7-4990-8e5e-5b620a659e95 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-unplugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:49 user nova-compute[73627]: WARNING nova.compute.manager [req-b6379f55-83f5-4454-a265-111163392378 req-ec3d6a2d-9ce7-4990-8e5e-5b620a659e95 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received unexpected event network-vif-unplugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:29:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:49 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Instance destroyed successfully.
Aug 26 16:29:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:51 user nova-compute[73627]: WARNING nova.compute.manager [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received unexpected event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:29:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:51 user nova-compute[73627]: WARNING nova.compute.manager [req-526f0c56-8fb6-43e9-bde9-2b61b45d2c82 req-98e5f512-c535-40da-b3b0-f59c7be714ca service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received unexpected event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:29:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Removed pending event for 6907d670-3efe-473c-b03c-eb26c4b7ef4e due to event {{(pid=73627) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 16:29:53 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067393.704771, 6907d670-3efe-473c-b03c-eb26c4b7ef4e => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:53 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] VM Resumed (Lifecycle Event)
Aug 26 16:29:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5713dc60-6ac4-4ef6-875a-bb93461ca128 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:29:53 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 16:29:53 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067393.707439, 6907d670-3efe-473c-b03c-eb26c4b7ef4e => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:29:53 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] VM Started (Lifecycle Event)
Aug 26 16:29:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:29:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:29:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-d01b32e8-ca84-45b3-8aa0-1bddb7c58d6d req-8d584db7-398e-49ae-aa39-b937ff1b8202 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:29:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d01b32e8-ca84-45b3-8aa0-1bddb7c58d6d req-8d584db7-398e-49ae-aa39-b937ff1b8202 service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:29:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d01b32e8-ca84-45b3-8aa0-1bddb7c58d6d req-8d584db7-398e-49ae-aa39-b937ff1b8202 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:29:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d01b32e8-ca84-45b3-8aa0-1bddb7c58d6d req-8d584db7-398e-49ae-aa39-b937ff1b8202 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:29:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-d01b32e8-ca84-45b3-8aa0-1bddb7c58d6d req-8d584db7-398e-49ae-aa39-b937ff1b8202 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:29:53 user nova-compute[73627]: WARNING nova.compute.manager [req-d01b32e8-ca84-45b3-8aa0-1bddb7c58d6d req-8d584db7-398e-49ae-aa39-b937ff1b8202 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received unexpected event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with vm_state active and task_state None.
Aug 26 16:29:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:29:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:30:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:30:01 user nova-compute[73627]: INFO nova.compute.claims [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Claim successful on node user
Aug 26 16:30:02 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:30:02 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:30:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:30:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:30:02 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:30:02 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:30:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:30:02 user nova-compute[73627]: INFO nova.virt.block_device [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Booting with volume-backed-image 7c378a38-67f2-4800-b3b2-bf66a493a20b at /dev/vda
Aug 26 16:30:02 user nova-compute[73627]: DEBUG nova.policy [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f24169ea97724e1288631ea977a068bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b8b30c15b8423e90156082111b000f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:30:02 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:30:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:02 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:30:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:30:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:03 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Successfully created port: 7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:30:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Successfully updated port: 7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquired lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-1edf8d05-22f6-4e31-9d83-2edbf411598a req-53756c73-9a3b-4ea2-a7f8-ca6967fce47f service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-changed-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-1edf8d05-22f6-4e31-9d83-2edbf411598a req-53756c73-9a3b-4ea2-a7f8-ca6967fce47f service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Refreshing instance network info cache due to event network-changed-7252e98b-6ee2-4b47-a339-16612b95c731. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1edf8d05-22f6-4e31-9d83-2edbf411598a req-53756c73-9a3b-4ea2-a7f8-ca6967fce47f service nova] Acquiring lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Updating instance_info_cache with network_info: [{"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Releasing lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Instance network_info: |[{"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1edf8d05-22f6-4e31-9d83-2edbf411598a req-53756c73-9a3b-4ea2-a7f8-ca6967fce47f service nova] Acquired lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:30:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-1edf8d05-22f6-4e31-9d83-2edbf411598a req-53756c73-9a3b-4ea2-a7f8-ca6967fce47f service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Refreshing network info cache for port 7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-1edf8d05-22f6-4e31-9d83-2edbf411598a req-53756c73-9a3b-4ea2-a7f8-ca6967fce47f service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Updated VIF entry in instance network info cache for port 7252e98b-6ee2-4b47-a339-16612b95c731. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-1edf8d05-22f6-4e31-9d83-2edbf411598a req-53756c73-9a3b-4ea2-a7f8-ca6967fce47f service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Updating instance_info_cache with network_info: [{"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1edf8d05-22f6-4e31-9d83-2edbf411598a req-53756c73-9a3b-4ea2-a7f8-ca6967fce47f service nova] Releasing lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:08 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:30:08 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=6906MB free_disk=25.45151138305664GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a20c0a68-9781-4d6c-8f55-6952f1758f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19c82f60-3294-4a09-96a3-b03a1673149c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b1f798a4-a09c-4a10-ba68-650b7c757f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c437818f-4799-4ad9-8463-f798c768cae9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 02728278-ff6a-41e3-b107-6e3106a56bc4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:30:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:30:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:30:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:30:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 16:30:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:30:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:30:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:30:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:30:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:30:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:30:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:30:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG os_brick.utils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6603a3-410d-45a1-b026-11812ea346b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba658d5d-5405-4749-ae51-234f6331b841]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[34644fef-7876-4b6a-bbf6-05cded57bc21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82d231a-c89e-465b-9a06-33c38bf973fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:30:13 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:30:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dcd538-458c-4420-a973-75c8f6f7c6d1]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG os_brick.utils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:30:13 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Updating existing volume attachment record: a783e0c9-e5cd-4e57-ac71-0909ccf1ac89 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:30:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:30:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:30:19 user nova-compute[73627]: INFO nova.compute.claims [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Claim successful on node user
Aug 26 16:30:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:19 user nova-compute[73627]: INFO nova.compute.manager [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Terminating instance
Aug 26 16:30:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:30:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.network.neutron [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:30:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-0fc76e39-9e89-4a26-b0cf-d2bdebb5f91f req-8a0abf52-a8ab-4fb3-85e6-dd30a6e97acf service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Received event network-vif-unplugged-e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0fc76e39-9e89-4a26-b0cf-d2bdebb5f91f req-8a0abf52-a8ab-4fb3-85e6-dd30a6e97acf service nova] Acquiring lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0fc76e39-9e89-4a26-b0cf-d2bdebb5f91f req-8a0abf52-a8ab-4fb3-85e6-dd30a6e97acf service nova] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0fc76e39-9e89-4a26-b0cf-d2bdebb5f91f req-8a0abf52-a8ab-4fb3-85e6-dd30a6e97acf service nova] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-0fc76e39-9e89-4a26-b0cf-d2bdebb5f91f req-8a0abf52-a8ab-4fb3-85e6-dd30a6e97acf service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] No waiting events found dispatching network-vif-unplugged-e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-0fc76e39-9e89-4a26-b0cf-d2bdebb5f91f req-8a0abf52-a8ab-4fb3-85e6-dd30a6e97acf service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Received event network-vif-unplugged-e70e03b5-2564-4008-b416-306d76ad521c for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.policy [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd643e68350c749df9a033c5ee9bae19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78924631c2e241b0b0c5cb8c9c24b4a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:30:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Creating image(s)
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "/opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "/opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "/opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.203s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Instance destroyed successfully.
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.objects.instance [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lazy-loading 'resources' on Instance uuid 19fcf882-d14e-4478-aed6-5e30db7d3e33 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1772519798',display_name='tempest-VolumesAdminNegativeTest-server-1772519798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1772519798',id=6,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqiKdM0+5Ods/ywUBEA055o/xK2DR1uCp/jTxgI8IFHWDyljelMA0exdEUAh/gSjHZ6aVyiTIE8I3AePL859Ug9UdtcAPAI1c+Z2vmAudah551exQ/4mE/+tWq8MS7rRw==',key_name='tempest-keypair-605993154',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:23:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db772b720283431e97eb7ccbd346884d',ramdisk_id='',reservation_id='r-3lg72hfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-8811083',owner_user_name='tempest-VolumesAdminNegativeTest-8811083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:23:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46cb037a25de4d47b21fe34498409ad7',uuid=19fcf882-d14e-4478-aed6-5e30db7d3e33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converting VIF {"id": "e70e03b5-2564-4008-b416-306d76ad521c", "address": "fa:16:3e:c0:cd:01", "network": {"id": "12decca3-5f0c-45d3-9bb5-48b361a54963", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1881463048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db772b720283431e97eb7ccbd346884d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70e03b5-25", "ovs_interfaceid": "e70e03b5-2564-4008-b416-306d76ad521c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=e70e03b5-2564-4008-b416-306d76ad521c,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70e03b5-25') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG os_vif [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=e70e03b5-2564-4008-b416-306d76ad521c,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70e03b5-25') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape70e03b5-25, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:20 user nova-compute[73627]: INFO os_vif [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:cd:01,bridge_name='br-int',has_traffic_filtering=True,id=e70e03b5-2564-4008-b416-306d76ad521c,network=Network(12decca3-5f0c-45d3-9bb5-48b361a54963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70e03b5-25')
Aug 26 16:30:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Deleting instance files /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33_del
Aug 26 16:30:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Deletion of /opt/stack/data/nova/instances/19fcf882-d14e-4478-aed6-5e30db7d3e33_del complete
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.202s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk 1073741824" returned: 0 in 0.059s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:20 user nova-compute[73627]: INFO nova.compute.manager [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 16:30:20 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:30:20 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.195s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG nova.network.neutron [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Successfully created port: 85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Cannot resize image /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Ensure instance console log exists: /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:30:21 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Took 0.99 seconds to deallocate network for instance.
Aug 26 16:30:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-de60be81-d451-4c21-a2ca-6923c3907419 req-4dd4f65e-b258-4043-b5e8-215d26154826 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Received event network-vif-deleted-e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:21 user nova-compute[73627]: INFO nova.compute.manager [req-de60be81-d451-4c21-a2ca-6923c3907419 req-4dd4f65e-b258-4043-b5e8-215d26154826 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Neutron deleted interface e70e03b5-2564-4008-b416-306d76ad521c; detaching it from the instance and deleting it from the info cache
Aug 26 16:30:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-de60be81-d451-4c21-a2ca-6923c3907419 req-4dd4f65e-b258-4043-b5e8-215d26154826 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:30:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-de60be81-d451-4c21-a2ca-6923c3907419 req-4dd4f65e-b258-4043-b5e8-215d26154826 service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Detach interface failed, port_id=e70e03b5-2564-4008-b416-306d76ad521c, reason: Instance 19fcf882-d14e-4478-aed6-5e30db7d3e33 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.network.neutron [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Successfully updated port: 85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "refresh_cache-f27b7e07-8da2-4562-8ee4-5cec29543a01" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquired lock "refresh_cache-f27b7e07-8da2-4562-8ee4-5cec29543a01" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.network.neutron [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-72f0f03c-661b-4e57-865b-001b50bd97db req-29fb7daf-4880-47d6-a136-33454a3f5ca2 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Received event network-changed-85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-72f0f03c-661b-4e57-865b-001b50bd97db req-29fb7daf-4880-47d6-a136-33454a3f5ca2 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Refreshing instance network info cache due to event network-changed-85e1be10-0bbc-46bd-87a7-7405dc3eed5c. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-72f0f03c-661b-4e57-865b-001b50bd97db req-29fb7daf-4880-47d6-a136-33454a3f5ca2 service nova] Acquiring lock "refresh_cache-f27b7e07-8da2-4562-8ee4-5cec29543a01" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.network.neutron [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-10ed2818-002e-40d1-b6dc-a8ed86dc9520 req-bb93abe8-875c-490c-8fb6-f1cdf869435a service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Received event network-vif-plugged-e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-10ed2818-002e-40d1-b6dc-a8ed86dc9520 req-bb93abe8-875c-490c-8fb6-f1cdf869435a service nova] Acquiring lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-10ed2818-002e-40d1-b6dc-a8ed86dc9520 req-bb93abe8-875c-490c-8fb6-f1cdf869435a service nova] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-10ed2818-002e-40d1-b6dc-a8ed86dc9520 req-bb93abe8-875c-490c-8fb6-f1cdf869435a service nova] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-10ed2818-002e-40d1-b6dc-a8ed86dc9520 req-bb93abe8-875c-490c-8fb6-f1cdf869435a service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] No waiting events found dispatching network-vif-plugged-e70e03b5-2564-4008-b416-306d76ad521c {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:30:22 user nova-compute[73627]: WARNING nova.compute.manager [req-10ed2818-002e-40d1-b6dc-a8ed86dc9520 req-bb93abe8-875c-490c-8fb6-f1cdf869435a service nova] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Received unexpected event network-vif-plugged-e70e03b5-2564-4008-b416-306d76ad521c for instance with vm_state deleted and task_state None.
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:22 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Deleted allocations for instance 19fcf882-d14e-4478-aed6-5e30db7d3e33
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-395ee9e6-e3af-422d-9a4e-97fb7cb43354 tempest-VolumesAdminNegativeTest-8811083 tempest-VolumesAdminNegativeTest-8811083-project-member] Lock "19fcf882-d14e-4478-aed6-5e30db7d3e33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.668s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.network.neutron [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Updating instance_info_cache with network_info: [{"id": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "address": "fa:16:3e:e2:ba:32", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1be10-0b", "ovs_interfaceid": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Releasing lock "refresh_cache-f27b7e07-8da2-4562-8ee4-5cec29543a01" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Instance network_info: |[{"id": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "address": "fa:16:3e:e2:ba:32", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1be10-0b", "ovs_interfaceid": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-72f0f03c-661b-4e57-865b-001b50bd97db req-29fb7daf-4880-47d6-a136-33454a3f5ca2 service nova] Acquired lock "refresh_cache-f27b7e07-8da2-4562-8ee4-5cec29543a01" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.network.neutron [req-72f0f03c-661b-4e57-865b-001b50bd97db req-29fb7daf-4880-47d6-a136-33454a3f5ca2 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Refreshing network info cache for port 85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Start _get_guest_xml network_info=[{"id": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "address": "fa:16:3e:e2:ba:32", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1be10-0b", "ovs_interfaceid": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:30:22 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:30:22 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1051563310',display_name='tempest-AttachVolumeNegativeTest-server-1051563310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1051563310',id=26,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqyXPc8dPDThz3VcoIH2dWmMn0SFaQQaVq7ufPkQJJteqbMIghhJguzunpJN7ZF78wUOLhD2iId3CT7Z2je5O+gnKEYUvnEPcvuh1JSVjZgG5tL8n3p615w0cRZVaVlTQ==',key_name='tempest-keypair-2071962199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-i11wovh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=f27b7e07-8da2-4562-8ee4-5cec29543a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "address": "fa:16:3e:e2:ba:32", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1be10-0b", "ovs_interfaceid": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "address": "fa:16:3e:e2:ba:32", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1be10-0b", "ovs_interfaceid": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1be10-0bbc-46bd-87a7-7405dc3eed5c,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1be10-0b') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.objects.instance [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'pci_devices' on Instance uuid f27b7e07-8da2-4562-8ee4-5cec29543a01 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:30:22 user nova-compute[73627]:   <uuid>f27b7e07-8da2-4562-8ee4-5cec29543a01</uuid>
Aug 26 16:30:22 user nova-compute[73627]:   <name>instance-0000001a</name>
Aug 26 16:30:22 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:30:22 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:30:22 user nova-compute[73627]:   <metadata>
Aug 26 16:30:22 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:30:22 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:30:22 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1051563310</nova:name>
Aug 26 16:30:22 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:30:22</nova:creationTime>
Aug 26 16:30:22 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:30:22 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:30:22 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:30:22 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:30:22 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:30:22 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:30:22 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:30:22 user nova-compute[73627]:       <nova:owner>
Aug 26 16:30:22 user nova-compute[73627]:         <nova:user uuid="d643e68350c749df9a033c5ee9bae19f">tempest-AttachVolumeNegativeTest-1218878917-project-member</nova:user>
Aug 26 16:30:22 user nova-compute[73627]:         <nova:project uuid="78924631c2e241b0b0c5cb8c9c24b4a4">tempest-AttachVolumeNegativeTest-1218878917</nova:project>
Aug 26 16:30:22 user nova-compute[73627]:       </nova:owner>
Aug 26 16:30:22 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:30:22 user nova-compute[73627]:       <nova:ports>
Aug 26 16:30:22 user nova-compute[73627]:         <nova:port uuid="85e1be10-0bbc-46bd-87a7-7405dc3eed5c">
Aug 26 16:30:22 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 16:30:22 user nova-compute[73627]:         </nova:port>
Aug 26 16:30:22 user nova-compute[73627]:       </nova:ports>
Aug 26 16:30:22 user nova-compute[73627]:     </nova:instance>
Aug 26 16:30:22 user nova-compute[73627]:   </metadata>
Aug 26 16:30:22 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:30:22 user nova-compute[73627]:     <system>
Aug 26 16:30:22 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:30:22 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:30:22 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:30:22 user nova-compute[73627]:       <entry name="serial">f27b7e07-8da2-4562-8ee4-5cec29543a01</entry>
Aug 26 16:30:22 user nova-compute[73627]:       <entry name="uuid">f27b7e07-8da2-4562-8ee4-5cec29543a01</entry>
Aug 26 16:30:22 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:30:22 user nova-compute[73627]:     </system>
Aug 26 16:30:22 user nova-compute[73627]:   </sysinfo>
Aug 26 16:30:22 user nova-compute[73627]:   <os>
Aug 26 16:30:22 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:30:22 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:30:22 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:30:22 user nova-compute[73627]:   </os>
Aug 26 16:30:22 user nova-compute[73627]:   <features>
Aug 26 16:30:22 user nova-compute[73627]:     <acpi/>
Aug 26 16:30:22 user nova-compute[73627]:     <apic/>
Aug 26 16:30:22 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:30:22 user nova-compute[73627]:   </features>
Aug 26 16:30:22 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:30:22 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:30:22 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:30:22 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:30:22 user nova-compute[73627]:   </clock>
Aug 26 16:30:22 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:30:22 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:30:22 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:30:22 user nova-compute[73627]:   </cpu>
Aug 26 16:30:22 user nova-compute[73627]:   <devices>
Aug 26 16:30:22 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:30:22 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:30:22 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk"/>
Aug 26 16:30:22 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:30:22 user nova-compute[73627]:     </disk>
Aug 26 16:30:22 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:30:22 user nova-compute[73627]:       <mac address="fa:16:3e:e2:ba:32"/>
Aug 26 16:30:22 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:30:22 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:30:22 user nova-compute[73627]:       <target dev="tap85e1be10-0b"/>
Aug 26 16:30:22 user nova-compute[73627]:     </interface>
Aug 26 16:30:22 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:30:22 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/console.log" append="off"/>
Aug 26 16:30:22 user nova-compute[73627]:     </serial>
Aug 26 16:30:22 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:30:22 user nova-compute[73627]:     <video>
Aug 26 16:30:22 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:30:22 user nova-compute[73627]:     </video>
Aug 26 16:30:22 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:30:22 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:30:22 user nova-compute[73627]:     </rng>
Aug 26 16:30:22 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:30:22 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:30:22 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:30:22 user nova-compute[73627]:     </memballoon>
Aug 26 16:30:22 user nova-compute[73627]:   </devices>
Aug 26 16:30:22 user nova-compute[73627]: </domain>
Aug 26 16:30:22 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1051563310',display_name='tempest-AttachVolumeNegativeTest-server-1051563310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1051563310',id=26,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqyXPc8dPDThz3VcoIH2dWmMn0SFaQQaVq7ufPkQJJteqbMIghhJguzunpJN7ZF78wUOLhD2iId3CT7Z2je5O+gnKEYUvnEPcvuh1JSVjZgG5tL8n3p615w0cRZVaVlTQ==',key_name='tempest-keypair-2071962199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-i11wovh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=f27b7e07-8da2-4562-8ee4-5cec29543a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "address": "fa:16:3e:e2:ba:32", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1be10-0b", "ovs_interfaceid": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "address": "fa:16:3e:e2:ba:32", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1be10-0b", "ovs_interfaceid": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1be10-0bbc-46bd-87a7-7405dc3eed5c,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1be10-0b') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG os_vif [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1be10-0bbc-46bd-87a7-7405dc3eed5c,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1be10-0b') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85e1be10-0b, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85e1be10-0b, col_values=(('external_ids', {'iface-id': '85e1be10-0bbc-46bd-87a7-7405dc3eed5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:ba:32', 'vm-uuid': 'f27b7e07-8da2-4562-8ee4-5cec29543a01'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:30:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:23 user nova-compute[73627]: INFO os_vif [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1be10-0bbc-46bd-87a7-7405dc3eed5c,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1be10-0b')
Aug 26 16:30:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:30:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No VIF found with MAC fa:16:3e:e2:ba:32, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:30:23 user nova-compute[73627]: DEBUG nova.network.neutron [req-72f0f03c-661b-4e57-865b-001b50bd97db req-29fb7daf-4880-47d6-a136-33454a3f5ca2 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Updated VIF entry in instance network info cache for port 85e1be10-0bbc-46bd-87a7-7405dc3eed5c. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:30:23 user nova-compute[73627]: DEBUG nova.network.neutron [req-72f0f03c-661b-4e57-865b-001b50bd97db req-29fb7daf-4880-47d6-a136-33454a3f5ca2 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Updating instance_info_cache with network_info: [{"id": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "address": "fa:16:3e:e2:ba:32", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1be10-0b", "ovs_interfaceid": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:30:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-72f0f03c-661b-4e57-865b-001b50bd97db req-29fb7daf-4880-47d6-a136-33454a3f5ca2 service nova] Releasing lock "refresh_cache-f27b7e07-8da2-4562-8ee4-5cec29543a01" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:30:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-773c2866-8e3c-4115-a566-39c4f03ea9be req-27f2a581-d2c7-4f01-910f-30ebbc4e0f7a service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Received event network-vif-plugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-773c2866-8e3c-4115-a566-39c4f03ea9be req-27f2a581-d2c7-4f01-910f-30ebbc4e0f7a service nova] Acquiring lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-773c2866-8e3c-4115-a566-39c4f03ea9be req-27f2a581-d2c7-4f01-910f-30ebbc4e0f7a service nova] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-773c2866-8e3c-4115-a566-39c4f03ea9be req-27f2a581-d2c7-4f01-910f-30ebbc4e0f7a service nova] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-773c2866-8e3c-4115-a566-39c4f03ea9be req-27f2a581-d2c7-4f01-910f-30ebbc4e0f7a service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] No waiting events found dispatching network-vif-plugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:30:24 user nova-compute[73627]: WARNING nova.compute.manager [req-773c2866-8e3c-4115-a566-39c4f03ea9be req-27f2a581-d2c7-4f01-910f-30ebbc4e0f7a service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Received unexpected event network-vif-plugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c for instance with vm_state building and task_state spawning.
Aug 26 16:30:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067426.672274, f27b7e07-8da2-4562-8ee4-5cec29543a01 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:30:26 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] VM Resumed (Lifecycle Event)
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-85eba079-0689-4393-bbdf-fbd1ccde8394 req-94ca378c-5092-4edd-902c-9191278de9a7 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Received event network-vif-plugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-85eba079-0689-4393-bbdf-fbd1ccde8394 req-94ca378c-5092-4edd-902c-9191278de9a7 service nova] Acquiring lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-85eba079-0689-4393-bbdf-fbd1ccde8394 req-94ca378c-5092-4edd-902c-9191278de9a7 service nova] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-85eba079-0689-4393-bbdf-fbd1ccde8394 req-94ca378c-5092-4edd-902c-9191278de9a7 service nova] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-85eba079-0689-4393-bbdf-fbd1ccde8394 req-94ca378c-5092-4edd-902c-9191278de9a7 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] No waiting events found dispatching network-vif-plugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:30:26 user nova-compute[73627]: WARNING nova.compute.manager [req-85eba079-0689-4393-bbdf-fbd1ccde8394 req-94ca378c-5092-4edd-902c-9191278de9a7 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Received unexpected event network-vif-plugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c for instance with vm_state building and task_state spawning.
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:30:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Instance spawned successfully.
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:26 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067426.6726885, f27b7e07-8da2-4562-8ee4-5cec29543a01 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:30:26 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] VM Started (Lifecycle Event)
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:30:26 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:30:26 user nova-compute[73627]: INFO nova.compute.manager [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Took 6.42 seconds to spawn the instance on the hypervisor.
Aug 26 16:30:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:26 user nova-compute[73627]: INFO nova.compute.manager [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Took 7.41 seconds to build instance.
Aug 26 16:30:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-442a9153-9ec1-4c57-8001-14a7b479f46c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.510s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:30:30 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Creating image(s)
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Ensure instance console log exists: /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Start _get_guest_xml network_info=[{"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skaSoEfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '995309d1-3ec1-4ded-a2b5-5c359d2f3f48', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4', 'serial': 'e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4'}, 'guest_format': None, 'attachment_id': 'a783e0c9-e5cd-4e57-ac71-0909ccf1ac89', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:30:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:30:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skaSoEfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:30:30 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:30:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:30:30 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:30:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:30:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:30:30 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:30:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2216fac3-ed9d-49a6-ab3d-17e96e8e69eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:30:31 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5754784e-8cea-4f5c-8083-0142912a8610]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4] added
Aug 26 16:30:31 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[089d7d18-491f-4815-832f-25c560f441fa]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc457830-bf10-4402-8308-2c6209cdf5fe]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skaSoEfY {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skaSoEfY" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d49af4-b63d-48f2-98d2-896c514ea32b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'skaSoEfY'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[68db1830-fc03-4c2b-83d2-4b3193d537db]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fc7943-0d66-4edb-8d72-043c44468cf8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:30:31 user nova-compute[73627]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:30:31 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:30:31 user nova-compute[73627]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:30:31 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce97346-b236-4681-a95b-a13360a61630]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4, portal: 172.16.0.220,3260]
Aug 26 16:30:31 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4, portal: 172.16.0.220,3260] successful.
Aug 26 16:30:31 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a05a71-a8a5-447d-bcaf-b2e652de975f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcfe119-fbbf-4f2b-80b0-6476676cdaaa]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:30:31 user nova-compute[73627]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:30:31 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:30:31 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:30:31 user nova-compute[73627]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:30:31 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:30:31 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77ca923-45a6-4edb-b50b-da9c78e734ea]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:30:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skaSoEfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23539663435376136', 'path': '/dev/sdd'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539663435376136', 'path': '/dev/sdd'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-450066436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-450066436',id=25,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b8b30c15b8423e90156082111b000f',ramdisk_id='',reservation_id='r-7s3q8pbq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:30:02Z,user_data=None,user_id='f24169ea97724e1288631ea977a068bd',uuid=995309d1-3ec1-4ded-a2b5-5c359d2f3f48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converting VIF {"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9b:20,bridge_name='br-int',has_traffic_filtering=True,id=7252e98b-6ee2-4b47-a339-16612b95c731,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7252e98b-6e') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'pci_devices' on Instance uuid 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:30:32 user nova-compute[73627]:   <uuid>995309d1-3ec1-4ded-a2b5-5c359d2f3f48</uuid>
Aug 26 16:30:32 user nova-compute[73627]:   <name>instance-00000019</name>
Aug 26 16:30:32 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:30:32 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:30:32 user nova-compute[73627]:   <metadata>
Aug 26 16:30:32 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:30:32 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:30:32 user nova-compute[73627]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-450066436</nova:name>
Aug 26 16:30:32 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:30:30</nova:creationTime>
Aug 26 16:30:32 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:30:32 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:30:32 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:30:32 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:30:32 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:30:32 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:30:32 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:30:32 user nova-compute[73627]:       <nova:owner>
Aug 26 16:30:32 user nova-compute[73627]:         <nova:user uuid="f24169ea97724e1288631ea977a068bd">tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member</nova:user>
Aug 26 16:30:32 user nova-compute[73627]:         <nova:project uuid="c8b8b30c15b8423e90156082111b000f">tempest-ServerBootFromVolumeStableRescueTest-2135030864</nova:project>
Aug 26 16:30:32 user nova-compute[73627]:       </nova:owner>
Aug 26 16:30:32 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:30:32 user nova-compute[73627]:       <nova:ports>
Aug 26 16:30:32 user nova-compute[73627]:         <nova:port uuid="7252e98b-6ee2-4b47-a339-16612b95c731">
Aug 26 16:30:32 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 16:30:32 user nova-compute[73627]:         </nova:port>
Aug 26 16:30:32 user nova-compute[73627]:       </nova:ports>
Aug 26 16:30:32 user nova-compute[73627]:     </nova:instance>
Aug 26 16:30:32 user nova-compute[73627]:   </metadata>
Aug 26 16:30:32 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:30:32 user nova-compute[73627]:     <system>
Aug 26 16:30:32 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:30:32 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:30:32 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:30:32 user nova-compute[73627]:       <entry name="serial">995309d1-3ec1-4ded-a2b5-5c359d2f3f48</entry>
Aug 26 16:30:32 user nova-compute[73627]:       <entry name="uuid">995309d1-3ec1-4ded-a2b5-5c359d2f3f48</entry>
Aug 26 16:30:32 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:30:32 user nova-compute[73627]:     </system>
Aug 26 16:30:32 user nova-compute[73627]:   </sysinfo>
Aug 26 16:30:32 user nova-compute[73627]:   <os>
Aug 26 16:30:32 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:30:32 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:30:32 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:30:32 user nova-compute[73627]:   </os>
Aug 26 16:30:32 user nova-compute[73627]:   <features>
Aug 26 16:30:32 user nova-compute[73627]:     <acpi/>
Aug 26 16:30:32 user nova-compute[73627]:     <apic/>
Aug 26 16:30:32 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:30:32 user nova-compute[73627]:   </features>
Aug 26 16:30:32 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:30:32 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:30:32 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:30:32 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:30:32 user nova-compute[73627]:   </clock>
Aug 26 16:30:32 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:30:32 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:30:32 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:30:32 user nova-compute[73627]:   </cpu>
Aug 26 16:30:32 user nova-compute[73627]:   <devices>
Aug 26 16:30:32 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:30:32 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:30:32 user nova-compute[73627]:       <source dev="/dev/sdd"/>
Aug 26 16:30:32 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:30:32 user nova-compute[73627]:       <serial>e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4</serial>
Aug 26 16:30:32 user nova-compute[73627]:     </disk>
Aug 26 16:30:32 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:30:32 user nova-compute[73627]:       <mac address="fa:16:3e:c5:9b:20"/>
Aug 26 16:30:32 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:30:32 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:30:32 user nova-compute[73627]:       <target dev="tap7252e98b-6e"/>
Aug 26 16:30:32 user nova-compute[73627]:     </interface>
Aug 26 16:30:32 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:30:32 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/console.log" append="off"/>
Aug 26 16:30:32 user nova-compute[73627]:     </serial>
Aug 26 16:30:32 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:30:32 user nova-compute[73627]:     <video>
Aug 26 16:30:32 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:30:32 user nova-compute[73627]:     </video>
Aug 26 16:30:32 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:30:32 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:30:32 user nova-compute[73627]:     </rng>
Aug 26 16:30:32 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:30:32 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:30:32 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:30:32 user nova-compute[73627]:     </memballoon>
Aug 26 16:30:32 user nova-compute[73627]:   </devices>
Aug 26 16:30:32 user nova-compute[73627]: </domain>
Aug 26 16:30:32 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-450066436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-450066436',id=25,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b8b30c15b8423e90156082111b000f',ramdisk_id='',reservation_id='r-7s3q8pbq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:30:02Z,user_data=None,user_id='f24169ea97724e1288631ea977a068bd',uuid=995309d1-3ec1-4ded-a2b5-5c359d2f3f48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converting VIF {"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9b:20,bridge_name='br-int',has_traffic_filtering=True,id=7252e98b-6ee2-4b47-a339-16612b95c731,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7252e98b-6e') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG os_vif [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9b:20,bridge_name='br-int',has_traffic_filtering=True,id=7252e98b-6ee2-4b47-a339-16612b95c731,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7252e98b-6e') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7252e98b-6e, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7252e98b-6e, col_values=(('external_ids', {'iface-id': '7252e98b-6ee2-4b47-a339-16612b95c731', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:9b:20', 'vm-uuid': '995309d1-3ec1-4ded-a2b5-5c359d2f3f48'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:32 user nova-compute[73627]: INFO os_vif [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9b:20,bridge_name='br-int',has_traffic_filtering=True,id=7252e98b-6ee2-4b47-a339-16612b95c731,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7252e98b-6e')
Aug 26 16:30:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:30:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] No VIF found with MAC fa:16:3e:c5:9b:20, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:30:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-5e40d001-3284-4d94-b7bb-f369e01e24f5 req-35ec0033-263e-43f3-b312-df6ecc5499a2 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5e40d001-3284-4d94-b7bb-f369e01e24f5 req-35ec0033-263e-43f3-b312-df6ecc5499a2 service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5e40d001-3284-4d94-b7bb-f369e01e24f5 req-35ec0033-263e-43f3-b312-df6ecc5499a2 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5e40d001-3284-4d94-b7bb-f369e01e24f5 req-35ec0033-263e-43f3-b312-df6ecc5499a2 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-5e40d001-3284-4d94-b7bb-f369e01e24f5 req-35ec0033-263e-43f3-b312-df6ecc5499a2 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:30:34 user nova-compute[73627]: WARNING nova.compute.manager [req-5e40d001-3284-4d94-b7bb-f369e01e24f5 req-35ec0033-263e-43f3-b312-df6ecc5499a2 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received unexpected event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with vm_state building and task_state spawning.
Aug 26 16:30:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067420.7305853, 19fcf882-d14e-4478-aed6-5e30db7d3e33 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:30:35 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] VM Stopped (Lifecycle Event)
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-56e607d4-00c5-4bfe-ab27-5b2ff7daaf63 None None] [instance: 19fcf882-d14e-4478-aed6-5e30db7d3e33] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067435.875156, 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:30:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] VM Resumed (Lifecycle Event)
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:30:35 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Instance spawned successfully.
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:30:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067435.8766527, 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:30:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] VM Started (Lifecycle Event)
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:30:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:30:35 user nova-compute[73627]: INFO nova.compute.manager [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 26 16:30:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:36 user nova-compute[73627]: INFO nova.compute.manager [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Took 34.41 seconds to build instance.
Aug 26 16:30:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8a154f84-bed3-43e0-b37b-bb2b7b6af86e tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.501s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-0da44226-fa3b-4204-bd65-1e5930202aff req-536f91b0-0b1f-4332-bd2c-7d867485fc58 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0da44226-fa3b-4204-bd65-1e5930202aff req-536f91b0-0b1f-4332-bd2c-7d867485fc58 service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0da44226-fa3b-4204-bd65-1e5930202aff req-536f91b0-0b1f-4332-bd2c-7d867485fc58 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0da44226-fa3b-4204-bd65-1e5930202aff req-536f91b0-0b1f-4332-bd2c-7d867485fc58 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-0da44226-fa3b-4204-bd65-1e5930202aff req-536f91b0-0b1f-4332-bd2c-7d867485fc58 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:30:36 user nova-compute[73627]: WARNING nova.compute.manager [req-0da44226-fa3b-4204-bd65-1e5930202aff req-536f91b0-0b1f-4332-bd2c-7d867485fc58 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received unexpected event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with vm_state active and task_state None.
Aug 26 16:30:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-b03afce2-a5b1-4ee6-bd0e-f7b4cd609b69 req-c51e98cc-2b9b-49ab-9d4f-236a9d6500ac service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-changed-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-b03afce2-a5b1-4ee6-bd0e-f7b4cd609b69 req-c51e98cc-2b9b-49ab-9d4f-236a9d6500ac service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Refreshing instance network info cache due to event network-changed-acc0dfcd-a792-461b-890b-47ad7a7ca1e4. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:30:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b03afce2-a5b1-4ee6-bd0e-f7b4cd609b69 req-c51e98cc-2b9b-49ab-9d4f-236a9d6500ac service nova] Acquiring lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:30:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b03afce2-a5b1-4ee6-bd0e-f7b4cd609b69 req-c51e98cc-2b9b-49ab-9d4f-236a9d6500ac service nova] Acquired lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:30:39 user nova-compute[73627]: DEBUG nova.network.neutron [req-b03afce2-a5b1-4ee6-bd0e-f7b4cd609b69 req-c51e98cc-2b9b-49ab-9d4f-236a9d6500ac service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Refreshing network info cache for port acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:30:40 user nova-compute[73627]: DEBUG nova.network.neutron [req-b03afce2-a5b1-4ee6-bd0e-f7b4cd609b69 req-c51e98cc-2b9b-49ab-9d4f-236a9d6500ac service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updated VIF entry in instance network info cache for port acc0dfcd-a792-461b-890b-47ad7a7ca1e4. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:30:40 user nova-compute[73627]: DEBUG nova.network.neutron [req-b03afce2-a5b1-4ee6-bd0e-f7b4cd609b69 req-c51e98cc-2b9b-49ab-9d4f-236a9d6500ac service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updating instance_info_cache with network_info: [{"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:30:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b03afce2-a5b1-4ee6-bd0e-f7b4cd609b69 req-c51e98cc-2b9b-49ab-9d4f-236a9d6500ac service nova] Releasing lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:30:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG nova.objects.instance [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquired lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG nova.network.neutron [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG nova.objects.instance [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'info_cache' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG nova.objects.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG nova.network.neutron [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Updating instance_info_cache with network_info: [{"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Releasing lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:30:43 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance destroyed successfully.
Aug 26 16:30:43 user nova-compute[73627]: DEBUG nova.objects.instance [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'resources' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG nova.objects.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1917134968',display_name='tempest-AttachVolumeTestJSON-server-1917134968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1917134968',id=16,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmPyc6b8C0t21vVKkIWZ8TNBX7zHUhspQfWwTTrOQhl3lcjdUwR4/NQ46CDlwG3vnNcoZ8dr3nq8LPGrMhj+EHJbbjv6sYh5dC2wyhw9PPy0yzES0uh+NmbTaehI0g66w==',key_name='tempest-keypair-1635152815',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0x3g7upm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:28:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=903e3d2f-fd02-4a36-8b02-dba90b33b8f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG os_vif [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfd70b91-61, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:30:43 user nova-compute[73627]: INFO os_vif [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61')
Aug 26 16:30:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbWXUMcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:30:43 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:30:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:30:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[15afa6d9-e67b-4402-857f-3409af9ce795]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d903daf8-0dcc-43f5-a4e7-6952e3b767a0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d02439a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0dd6ca-8b9b-49fe-a7ac-7f287d0888b3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5062f17d-b3ba-4735-b4a4-aa3b1db28a11]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c25b4c6-4489-4cd1-90d3-fede5a365f84]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[85859b4b-4e9f-43e4-99e2-8ca1d6fabea0]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1717fe-0472-4d25-8eb0-eb0307a71f92]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8727626-a185-4b11-9567-4891c8536c45]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260]
Aug 26 16:30:44 user nova-compute[73627]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260] successful.
Aug 26 16:30:44 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe2536-f5b5-4503-866f-beec5458c8d2]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] <== disconnect_volume: return (299ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Start _get_guest_xml network_info=[{"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbWXUMcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '903e3d2f-fd02-4a36-8b02-dba90b33b8f3', 'attached_at': '', 'detached_at': '', 'volume_id': '6cb32b9d-e58b-4ea0-a116-be9b8797f5d5', 'serial': '6cb32b9d-e58b-4ea0-a116-be9b8797f5d5'}, 'guest_format': None, 'attachment_id': '1500905c-5c4e-4d66-ab83-5cf6d5ac9421', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.objects.instance [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'numa_topology' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.objects.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:30:44 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:30:44 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.objects.instance [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'vcpu_model' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.objects.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbWXUMcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:30:44 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:30:44 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:30:44 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[474b4ba4-aef4-4b1e-b2ae-de79b618a2dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:30:44 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e506c8d-aa43-4045-9802-2167a6431819]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5] added
Aug 26 16:30:44 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe00e94-93c8-4143-b52f-7aa2a638f5aa]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f0fcd7-a107-4ec8-89ba-aa762b1e6e0e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbWXUMcd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbWXUMcd" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9552f20c-f29e-4695-8a8d-f2bceccd6a47]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbWXUMcd'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[32210564-3b3d-4191-b9cf-6a7c9591ca9d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ceea35-df31-4f84-a8f1-b67d7b57c808]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f1f65d-6f9c-4f2a-b2ca-680f00ccabbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260]
Aug 26 16:30:44 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260] successful.
Aug 26 16:30:44 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d23bec8-30fe-48ff-9dea-20aaffb43ba0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eff143e-4cb4-4503-998e-2ef95a9b7047]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:30:44 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ed7793-95f4-4032-9575-bc188c26a02f]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:30:44 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbWXUMcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:45 user nova-compute[73627]: INFO nova.compute.manager [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Shelving
Aug 26 16:30:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26163333732616136', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163333732616136', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1917134968',display_name='tempest-AttachVolumeTestJSON-server-1917134968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1917134968',id=16,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmPyc6b8C0t21vVKkIWZ8TNBX7zHUhspQfWwTTrOQhl3lcjdUwR4/NQ46CDlwG3vnNcoZ8dr3nq8LPGrMhj+EHJbbjv6sYh5dC2wyhw9PPy0yzES0uh+NmbTaehI0g66w==',key_name='tempest-keypair-1635152815',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0x3g7upm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:28:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=903e3d2f-fd02-4a36-8b02-dba90b33b8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG nova.objects.instance [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'pci_devices' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG nova.objects.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:30:45 user nova-compute[73627]:   <uuid>903e3d2f-fd02-4a36-8b02-dba90b33b8f3</uuid>
Aug 26 16:30:45 user nova-compute[73627]:   <name>instance-00000010</name>
Aug 26 16:30:45 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:30:45 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:30:45 user nova-compute[73627]:   <metadata>
Aug 26 16:30:45 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:30:45 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:30:45 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeTestJSON-server-1917134968</nova:name>
Aug 26 16:30:45 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:30:44</nova:creationTime>
Aug 26 16:30:45 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:30:45 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:30:45 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:30:45 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:30:45 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:30:45 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:30:45 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:30:45 user nova-compute[73627]:       <nova:owner>
Aug 26 16:30:45 user nova-compute[73627]:         <nova:user uuid="5067f58846cf44fc9799db04de44d116">tempest-AttachVolumeTestJSON-1152498749-project-member</nova:user>
Aug 26 16:30:45 user nova-compute[73627]:         <nova:project uuid="875ad08232174cb391be66a7d5605d8d">tempest-AttachVolumeTestJSON-1152498749</nova:project>
Aug 26 16:30:45 user nova-compute[73627]:       </nova:owner>
Aug 26 16:30:45 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:30:45 user nova-compute[73627]:       <nova:ports>
Aug 26 16:30:45 user nova-compute[73627]:         <nova:port uuid="cfd70b91-61a4-4ad8-9354-412fb74106c1">
Aug 26 16:30:45 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 16:30:45 user nova-compute[73627]:         </nova:port>
Aug 26 16:30:45 user nova-compute[73627]:       </nova:ports>
Aug 26 16:30:45 user nova-compute[73627]:     </nova:instance>
Aug 26 16:30:45 user nova-compute[73627]:   </metadata>
Aug 26 16:30:45 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:30:45 user nova-compute[73627]:     <system>
Aug 26 16:30:45 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:30:45 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:30:45 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:30:45 user nova-compute[73627]:       <entry name="serial">903e3d2f-fd02-4a36-8b02-dba90b33b8f3</entry>
Aug 26 16:30:45 user nova-compute[73627]:       <entry name="uuid">903e3d2f-fd02-4a36-8b02-dba90b33b8f3</entry>
Aug 26 16:30:45 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:30:45 user nova-compute[73627]:     </system>
Aug 26 16:30:45 user nova-compute[73627]:   </sysinfo>
Aug 26 16:30:45 user nova-compute[73627]:   <os>
Aug 26 16:30:45 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:30:45 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:30:45 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:30:45 user nova-compute[73627]:   </os>
Aug 26 16:30:45 user nova-compute[73627]:   <features>
Aug 26 16:30:45 user nova-compute[73627]:     <acpi/>
Aug 26 16:30:45 user nova-compute[73627]:     <apic/>
Aug 26 16:30:45 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:30:45 user nova-compute[73627]:   </features>
Aug 26 16:30:45 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:30:45 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:30:45 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:30:45 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:30:45 user nova-compute[73627]:   </clock>
Aug 26 16:30:45 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:30:45 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:30:45 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:30:45 user nova-compute[73627]:   </cpu>
Aug 26 16:30:45 user nova-compute[73627]:   <devices>
Aug 26 16:30:45 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:30:45 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:30:45 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk"/>
Aug 26 16:30:45 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:30:45 user nova-compute[73627]:     </disk>
Aug 26 16:30:45 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:30:45 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:30:45 user nova-compute[73627]:       <source dev="/dev/sdb"/>
Aug 26 16:30:45 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:30:45 user nova-compute[73627]:       <serial>6cb32b9d-e58b-4ea0-a116-be9b8797f5d5</serial>
Aug 26 16:30:45 user nova-compute[73627]:     </disk>
Aug 26 16:30:45 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:30:45 user nova-compute[73627]:       <mac address="fa:16:3e:d1:9a:8b"/>
Aug 26 16:30:45 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:30:45 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:30:45 user nova-compute[73627]:       <target dev="tapcfd70b91-61"/>
Aug 26 16:30:45 user nova-compute[73627]:     </interface>
Aug 26 16:30:45 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:30:45 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/console.log" append="off"/>
Aug 26 16:30:45 user nova-compute[73627]:     </serial>
Aug 26 16:30:45 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:30:45 user nova-compute[73627]:     <video>
Aug 26 16:30:45 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:30:45 user nova-compute[73627]:     </video>
Aug 26 16:30:45 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:30:45 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:30:45 user nova-compute[73627]:     </rng>
Aug 26 16:30:45 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:30:45 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:30:45 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:30:45 user nova-compute[73627]:     </memballoon>
Aug 26 16:30:45 user nova-compute[73627]:   </devices>
Aug 26 16:30:45 user nova-compute[73627]: </domain>
Aug 26 16:30:45 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-2ea55a60-9c41-48f3-9793-2c2d7cca6cd9 req-6244d482-5090-4c0a-bf4a-14960db88778 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-unplugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2ea55a60-9c41-48f3-9793-2c2d7cca6cd9 req-6244d482-5090-4c0a-bf4a-14960db88778 service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2ea55a60-9c41-48f3-9793-2c2d7cca6cd9 req-6244d482-5090-4c0a-bf4a-14960db88778 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2ea55a60-9c41-48f3-9793-2c2d7cca6cd9 req-6244d482-5090-4c0a-bf4a-14960db88778 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-2ea55a60-9c41-48f3-9793-2c2d7cca6cd9 req-6244d482-5090-4c0a-bf4a-14960db88778 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-unplugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:30:45 user nova-compute[73627]: WARNING nova.compute.manager [req-2ea55a60-9c41-48f3-9793-2c2d7cca6cd9 req-6244d482-5090-4c0a-bf4a-14960db88778 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received unexpected event network-vif-unplugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with vm_state active and task_state shelving.
Aug 26 16:30:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG nova.objects.instance [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'trusted_certs' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG nova.objects.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:46 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Instance destroyed successfully.
Aug 26 16:30:46 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Beginning cold snapshot process
Aug 26 16:30:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk /opt/stack/data/nova/instances/snapshots/tmpbj53u3fy/a173551b96f64eaca06706370b0b3dd9 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Cannot resize image /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG nova.objects.instance [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'migration_context' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG nova.objects.base [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1917134968',display_name='tempest-AttachVolumeTestJSON-server-1917134968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1917134968',id=16,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmPyc6b8C0t21vVKkIWZ8TNBX7zHUhspQfWwTTrOQhl3lcjdUwR4/NQ46CDlwG3vnNcoZ8dr3nq8LPGrMhj+EHJbbjv6sYh5dC2wyhw9PPy0yzES0uh+NmbTaehI0g66w==',key_name='tempest-keypair-1635152815',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0x3g7upm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:28:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=903e3d2f-fd02-4a36-8b02-dba90b33b8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG os_vif [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfd70b91-61, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfd70b91-61, col_values=(('external_ids', {'iface-id': 'cfd70b91-61a4-4ad8-9354-412fb74106c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:9a:8b', 'vm-uuid': '903e3d2f-fd02-4a36-8b02-dba90b33b8f3'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:30:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:46 user nova-compute[73627]: INFO os_vif [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61')
Aug 26 16:30:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk /opt/stack/data/nova/instances/snapshots/tmpbj53u3fy/a173551b96f64eaca06706370b0b3dd9" returned: 0 in 1.021s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:47 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Snapshot extracted, beginning image upload
Aug 26 16:30:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-daebd8b4-8b6a-46f8-8fba-e97b778af4f2 req-73ace9df-dd5e-44fe-a847-97ce4c1b3ef4 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-daebd8b4-8b6a-46f8-8fba-e97b778af4f2 req-73ace9df-dd5e-44fe-a847-97ce4c1b3ef4 service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-daebd8b4-8b6a-46f8-8fba-e97b778af4f2 req-73ace9df-dd5e-44fe-a847-97ce4c1b3ef4 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-daebd8b4-8b6a-46f8-8fba-e97b778af4f2 req-73ace9df-dd5e-44fe-a847-97ce4c1b3ef4 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-daebd8b4-8b6a-46f8-8fba-e97b778af4f2 req-73ace9df-dd5e-44fe-a847-97ce4c1b3ef4 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:30:47 user nova-compute[73627]: WARNING nova.compute.manager [req-daebd8b4-8b6a-46f8-8fba-e97b778af4f2 req-73ace9df-dd5e-44fe-a847-97ce4c1b3ef4 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received unexpected event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 16:30:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:30:50 user nova-compute[73627]: WARNING nova.compute.manager [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state stopped and task_state powering-on.
Aug 26 16:30:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Received event network-changed-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Refreshing instance network info cache due to event network-changed-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] Acquiring lock "refresh_cache-c437818f-4799-4ad9-8463-f798c768cae9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] Acquired lock "refresh_cache-c437818f-4799-4ad9-8463-f798c768cae9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG nova.network.neutron [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Refreshing network info cache for port f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lazy-loading 'flavor' on Instance uuid c437818f-4799-4ad9-8463-f798c768cae9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.229s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:50 user nova-compute[73627]: INFO nova.compute.manager [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Attaching volume ac20d5e4-7cde-484f-a67a-bacecf961af9 to /dev/vdb
Aug 26 16:30:50 user nova-compute[73627]: DEBUG nova.network.neutron [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Updated VIF entry in instance network info cache for port f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG nova.network.neutron [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Updating instance_info_cache with network_info: [{"id": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "address": "fa:16:3e:c4:29:2c", "network": {"id": "332616a2-e157-4895-aae0-b62458e95855", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1228136515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8293bcf7a5574394925ca3cf956f0b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf080d0ea-ed", "ovs_interfaceid": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG os_brick.utils [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[db61b805-ed96-4fb7-b984-a7898d3c02ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] Releasing lock "refresh_cache-c437818f-4799-4ad9-8463-f798c768cae9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:30:50 user nova-compute[73627]: WARNING nova.compute.manager [req-1ee054f1-7bfb-4e4e-bd79-0c8a0870c500 req-6694af13-a0ac-45d8-9a86-6c2d73e2fa0c service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state stopped and task_state powering-on.
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d91d313-9708-4ad8-baa9-a9dbe2c2ac04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2968076-64d9-4e11-9a41-180f17fb6e4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305b122-5b37-4dde-bd38-a18b954b9378]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:30:50 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:30:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d67046-a517-4959-844e-42b85c8b3c68]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:30:50 user nova-compute[73627]: DEBUG os_brick.utils [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Updating existing volume attachment record: db22283b-77ce-41df-b906-b48936ee1c08 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:30:51 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Snapshot image upload complete
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:51 user nova-compute[73627]: INFO nova.compute.manager [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Shelve offloading
Aug 26 16:30:51 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Instance destroyed successfully.
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:30:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquired lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067451.2480643, 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:30:51 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] VM Resumed (Lifecycle Event)
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:30:51 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance rebooted successfully.
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-24232abf-4071-4c1d-82a5-39fe1b2c9084 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:30:51 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067451.24863, 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:30:51 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] VM Started (Lifecycle Event)
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:30:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:51 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updating instance_info_cache with network_info: [{"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:30:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Releasing lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:30:52 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Instance destroyed successfully.
Aug 26 16:30:52 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'resources' on Instance uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1313029250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1313029250',id=20,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Ve2IfJyqHfgM4j2Ukkn/LY683coRDCPGAAsz9e3ka/78aNiOeL/f3py3hYvGD8aA2KH2Z1BxUGJunxaaylIFIDdalkdbYI5hNec0W5iTvxkkLsdG3rIuOXZNIqtmbwg==',key_name='tempest-keypair-1653270261',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:28:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-8sdto70b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member',shelved_at='2023-08-26T16:30:51.100296',shelved_host='user',shelved_image_id='c23f8623-a8c0-4eca-b2f3-d630d592ec98'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:30:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=b1f798a4-a09c-4a10-ba68-650b7c757f7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG os_vif [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacc0dfcd-a7, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG nova.compute.manager [req-66d6cda6-ce1a-4c4b-bf8a-9d29d75086e6 req-79036caf-443b-445f-ac49-4ccc91b4d356 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-changed-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG nova.compute.manager [req-66d6cda6-ce1a-4c4b-bf8a-9d29d75086e6 req-79036caf-443b-445f-ac49-4ccc91b4d356 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Refreshing instance network info cache due to event network-changed-acc0dfcd-a792-461b-890b-47ad7a7ca1e4. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-66d6cda6-ce1a-4c4b-bf8a-9d29d75086e6 req-79036caf-443b-445f-ac49-4ccc91b4d356 service nova] Acquiring lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-66d6cda6-ce1a-4c4b-bf8a-9d29d75086e6 req-79036caf-443b-445f-ac49-4ccc91b4d356 service nova] Acquired lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG nova.network.neutron [req-66d6cda6-ce1a-4c4b-bf8a-9d29d75086e6 req-79036caf-443b-445f-ac49-4ccc91b4d356 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Refreshing network info cache for port acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:30:52 user nova-compute[73627]: INFO os_vif [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7')
Aug 26 16:30:52 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Deleting instance files /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f_del
Aug 26 16:30:52 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Deletion of /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f_del complete
Aug 26 16:30:52 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Deleted allocations for instance b1f798a4-a09c-4a10-ba68-650b7c757f7f
Aug 26 16:30:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'numa_topology' on Instance uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:30:52 user nova-compute[73627]: DEBUG nova.objects.base [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Object Instance<b1f798a4-a09c-4a10-ba68-650b7c757f7f> lazy-loaded attributes: resources,numa_topology {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:30:53 user nova-compute[73627]: DEBUG nova.network.neutron [req-66d6cda6-ce1a-4c4b-bf8a-9d29d75086e6 req-79036caf-443b-445f-ac49-4ccc91b4d356 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updated VIF entry in instance network info cache for port acc0dfcd-a792-461b-890b-47ad7a7ca1e4. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:30:53 user nova-compute[73627]: DEBUG nova.network.neutron [req-66d6cda6-ce1a-4c4b-bf8a-9d29d75086e6 req-79036caf-443b-445f-ac49-4ccc91b4d356 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updating instance_info_cache with network_info: [{"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:30:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-66d6cda6-ce1a-4c4b-bf8a-9d29d75086e6 req-79036caf-443b-445f-ac49-4ccc91b4d356 service nova] Releasing lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:30:53 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:30:53 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:30:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b1a6f99-4300-475a-b992-26b43c35e582 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.937s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:30:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:30:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-8081216a-98d1-48b3-8938-aefb435c5a0c req-035be989-2c93-407d-ad05-6311c0228a4c service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-changed-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-8081216a-98d1-48b3-8938-aefb435c5a0c req-035be989-2c93-407d-ad05-6311c0228a4c service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Refreshing instance network info cache due to event network-changed-d43b5527-a43b-4a93-88fb-db830093b5ea. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8081216a-98d1-48b3-8938-aefb435c5a0c req-035be989-2c93-407d-ad05-6311c0228a4c service nova] Acquiring lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8081216a-98d1-48b3-8938-aefb435c5a0c req-035be989-2c93-407d-ad05-6311c0228a4c service nova] Acquired lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-8081216a-98d1-48b3-8938-aefb435c5a0c req-035be989-2c93-407d-ad05-6311c0228a4c service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Refreshing network info cache for port d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067446.238407, b1f798a4-a09c-4a10-ba68-650b7c757f7f => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:31:01 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] VM Stopped (Lifecycle Event)
Aug 26 16:31:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b3de6d7c-b6e2-4d3b-94c8-99c278ea0c6c None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-8081216a-98d1-48b3-8938-aefb435c5a0c req-035be989-2c93-407d-ad05-6311c0228a4c service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updated VIF entry in instance network info cache for port d43b5527-a43b-4a93-88fb-db830093b5ea. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-8081216a-98d1-48b3-8938-aefb435c5a0c req-035be989-2c93-407d-ad05-6311c0228a4c service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating instance_info_cache with network_info: [{"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8081216a-98d1-48b3-8938-aefb435c5a0c req-035be989-2c93-407d-ad05-6311c0228a4c service nova] Releasing lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:01 user nova-compute[73627]: INFO nova.compute.manager [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Shelve offloading
Aug 26 16:31:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-995c6692-8dc8-4687-9593-2af33ba611d9 req-eac73e00-6ffb-4939-869d-c20146254c85 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-vif-unplugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-995c6692-8dc8-4687-9593-2af33ba611d9 req-eac73e00-6ffb-4939-869d-c20146254c85 service nova] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-995c6692-8dc8-4687-9593-2af33ba611d9 req-eac73e00-6ffb-4939-869d-c20146254c85 service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-995c6692-8dc8-4687-9593-2af33ba611d9 req-eac73e00-6ffb-4939-869d-c20146254c85 service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-995c6692-8dc8-4687-9593-2af33ba611d9 req-eac73e00-6ffb-4939-869d-c20146254c85 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] No waiting events found dispatching network-vif-unplugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:31:02 user nova-compute[73627]: WARNING nova.compute.manager [req-995c6692-8dc8-4687-9593-2af33ba611d9 req-eac73e00-6ffb-4939-869d-c20146254c85 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received unexpected event network-vif-unplugged-d43b5527-a43b-4a93-88fb-db830093b5ea for instance with vm_state active and task_state shelving.
Aug 26 16:31:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:02 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Instance destroyed successfully.
Aug 26 16:31:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquired lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG nova.network.neutron [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikecaqHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:02 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:02 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:02 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[16df8e2b-7f7d-4799-b1f6-00befb4b7b2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:31:02 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[61518f32-76b2-4783-b856-cc167cc3b058]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9] added
Aug 26 16:31:02 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b56a40-57af-43e8-8626-fda6e3ea5c93]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d342fc-0bd5-46e4-a3eb-4cc76b3a77e9]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikecaqHP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikecaqHP" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[368a8955-b4d1-4232-9694-67fa56dc687b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ikecaqHP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d3ffb8-0d8b-483f-a40d-32e39d3f3cb3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb25ea1d-7915-445e-9aad-c3924398fc26]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca35424-d7ec-4626-9ae5-d068f3affa5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260]
Aug 26 16:31:03 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260] successful.
Aug 26 16:31:03 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baa0c24-ef9c-4c6c-9317-4b160dbddecf]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[14abc109-c517-4162-a757-42f57c06c55c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:03 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d958018e-c206-4704-88bf-f035483cf6bd]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikecaqHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG nova.network.neutron [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating instance_info_cache with network_info: [{"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Releasing lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:03 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-4cd4cadd-0998-4617-bdc4-323724eb0d8b req-1a4cf7f0-6963-4e3b-8854-16d8cbe6270d service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4cd4cadd-0998-4617-bdc4-323724eb0d8b req-1a4cf7f0-6963-4e3b-8854-16d8cbe6270d service nova] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4cd4cadd-0998-4617-bdc4-323724eb0d8b req-1a4cf7f0-6963-4e3b-8854-16d8cbe6270d service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4cd4cadd-0998-4617-bdc4-323724eb0d8b req-1a4cf7f0-6963-4e3b-8854-16d8cbe6270d service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-4cd4cadd-0998-4617-bdc4-323724eb0d8b req-1a4cf7f0-6963-4e3b-8854-16d8cbe6270d service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] No waiting events found dispatching network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:31:04 user nova-compute[73627]: WARNING nova.compute.manager [req-4cd4cadd-0998-4617-bdc4-323724eb0d8b req-1a4cf7f0-6963-4e3b-8854-16d8cbe6270d service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received unexpected event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea for instance with vm_state active and task_state shelving.
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23362366430646635', 'path': '/dev/sde'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362366430646635', 'path': '/dev/sde'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lazy-loading 'flavor' on Instance uuid c437818f-4799-4ad9-8463-f798c768cae9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:31:04 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:31:04 user nova-compute[73627]:   <source dev="/dev/sde"/>
Aug 26 16:31:04 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:31:04 user nova-compute[73627]:   <serial>ac20d5e4-7cde-484f-a67a-bacecf961af9</serial>
Aug 26 16:31:04 user nova-compute[73627]: </disk>
Aug 26 16:31:04 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-78285974-5977-4c55-a071-6f940420cd41 req-d7203e74-2728-478c-aa0a-536d702c7cfd service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-changed-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-78285974-5977-4c55-a071-6f940420cd41 req-d7203e74-2728-478c-aa0a-536d702c7cfd service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Refreshing instance network info cache due to event network-changed-d43b5527-a43b-4a93-88fb-db830093b5ea. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-78285974-5977-4c55-a071-6f940420cd41 req-d7203e74-2728-478c-aa0a-536d702c7cfd service nova] Acquiring lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-78285974-5977-4c55-a071-6f940420cd41 req-d7203e74-2728-478c-aa0a-536d702c7cfd service nova] Acquired lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-78285974-5977-4c55-a071-6f940420cd41 req-d7203e74-2728-478c-aa0a-536d702c7cfd service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Refreshing network info cache for port d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:31:04 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Instance destroyed successfully.
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.objects.instance [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lazy-loading 'resources' on Instance uuid 02728278-ff6a-41e3-b107-6e3106a56bc4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2043883167',display_name='tempest-TestShelveInstance-server-2043883167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2043883167',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUkKnXOk52N39dKNATbuSDCnmPHibOJEXSNpU+Lcz5ewHglXuNqvhgMoqWj5qUG6vl4G0GQ85lQIO6MbKAV4Di+T05lsQA5XzeIA/ENSR9D2OajBzjcbs97FcAoX/6G+w==',key_name='tempest-TestShelveInstance-1574199453',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:29:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cb420f29dc849efa3c0b2d28ab50813',ramdisk_id='',reservation_id='r-uhsml3rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-562411929',owner_user_name='tempest-TestShelveInstance-562411929-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:29:31Z,user_data=None,user_id='419538c7a200483689e0e419b34e1489',uuid=02728278-ff6a-41e3-b107-6e3106a56bc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converting VIF {"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_vif [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd43b5527-a4, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:31:04 user nova-compute[73627]: INFO os_vif [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4')
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLTItXHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:04 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[92313392-b425-4941-96e3-fce87fd2242f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1433edab-2977-41fe-a9ea-1f7f6cc27c1c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:31:04 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:04 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:04 user nova-compute[73627]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:04 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:31:04 user nova-compute[73627]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:04 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:04 user nova-compute[73627]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:04 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d04b0430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[848cf9ff-8b4f-46dc-8e95-4735fa1d71e6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e319c573-1a6a-4bf9-8d84-9b0d12345863]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b069a0-114c-4c84-b68d-1264e1016983]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] No VIF found with MAC fa:16:3e:c4:29:2c, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6bd925-038a-4895-b4a2-c48b5005967c]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:31:04 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e1c40d-0e05-4be9-a7ff-d9e493f28dd4]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b11e933-397f-4cb6-9046-81ca34a9c55a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260]
Aug 26 16:31:05 user nova-compute[73627]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260] successful.
Aug 26 16:31:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ad22332-9e52-4f21-a597-6bb5fbee04c3 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.410s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c10db18-d289-4ebc-8d17-e2297da175e7]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] <== disconnect_volume: return (395ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:31:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Deleting instance files /opt/stack/data/nova/instances/02728278-ff6a-41e3-b107-6e3106a56bc4_del
Aug 26 16:31:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Deletion of /opt/stack/data/nova/instances/02728278-ff6a-41e3-b107-6e3106a56bc4_del complete
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-78285974-5977-4c55-a071-6f940420cd41 req-d7203e74-2728-478c-aa0a-536d702c7cfd service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updated VIF entry in instance network info cache for port d43b5527-a43b-4a93-88fb-db830093b5ea. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-78285974-5977-4c55-a071-6f940420cd41 req-d7203e74-2728-478c-aa0a-536d702c7cfd service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating instance_info_cache with network_info: [{"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": null, "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd43b5527-a4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-78285974-5977-4c55-a071-6f940420cd41 req-d7203e74-2728-478c-aa0a-536d702c7cfd service nova] Releasing lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:06 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Deleted allocations for instance 02728278-ff6a-41e3-b107-6e3106a56bc4
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "c437818f-4799-4ad9-8463-f798c768cae9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG os_brick.utils [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:06 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid '02728278-ff6a-41e3-b107-6e3106a56bc4' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid '02728278-ff6a-41e3-b107-6e3106a56bc4' (instance-00000016)
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG nova.objects.instance [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lazy-loading 'numa_topology' on Instance uuid 02728278-ff6a-41e3-b107-6e3106a56bc4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG nova.objects.base [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Object Instance<02728278-ff6a-41e3-b107-6e3106a56bc4> lazy-loaded attributes: resources,numa_topology {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18c0831-a7a1-44d8-9323-2797072ad643]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1067c7fc-1740-407d-b7bf-e64606d73955]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffccf264-3934-4dea-8e04-124161b18cc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe960f8-04f4-46af-ada4-6e4a446eb797]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:31:06 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[631607dc-0f7f-4540-a414-f58029285fd8]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG os_brick.utils [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] <== get_connector_properties: return (256ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:06 user nova-compute[73627]: INFO nova.compute.manager [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Swapping volume ac20d5e4-7cde-484f-a67a-bacecf961af9 for e4a076ad-efdc-40aa-9479-b4b513c765b6
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.552s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ed7257ed-e594-48d5-a0cc-27183514e03b tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.337s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:31:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:09 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:31:09 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=6888MB free_disk=25.414825439453125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a20c0a68-9781-4d6c-8f55-6952f1758f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19c82f60-3294-4a09-96a3-b03a1673149c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c437818f-4799-4ad9-8463-f798c768cae9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f27b7e07-8da2-4562-8ee4-5cec29543a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:31:11 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:31:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:31:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:31:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:31:11 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid 8164bb99-842e-49fc-8f36-093de455c311 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Updating instance_info_cache with network_info: [{"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:31:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-8164bb99-842e-49fc-8f36-093de455c311" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:31:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:31:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:31:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:31:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:31:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:31:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:31:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:31:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-2f75c669-a4ff-4913-8a10-cf9438d157c0 req-ea1ffbc9-9994-4861-9d92-9fc475ce236f service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-changed-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-2f75c669-a4ff-4913-8a10-cf9438d157c0 req-ea1ffbc9-9994-4861-9d92-9fc475ce236f service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Refreshing instance network info cache due to event network-changed-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:31:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2f75c669-a4ff-4913-8a10-cf9438d157c0 req-ea1ffbc9-9994-4861-9d92-9fc475ce236f service nova] Acquiring lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2f75c669-a4ff-4913-8a10-cf9438d157c0 req-ea1ffbc9-9994-4861-9d92-9fc475ce236f service nova] Acquired lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:17 user nova-compute[73627]: DEBUG nova.network.neutron [req-2f75c669-a4ff-4913-8a10-cf9438d157c0 req-ea1ffbc9-9994-4861-9d92-9fc475ce236f service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Refreshing network info cache for port 02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:31:17 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067462.635757, 02728278-ff6a-41e3-b107-6e3106a56bc4 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:31:17 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] VM Stopped (Lifecycle Event)
Aug 26 16:31:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c428dba6-f3a4-4dd6-9872-97a6e0b7b55a None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:31:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG nova.network.neutron [req-2f75c669-a4ff-4913-8a10-cf9438d157c0 req-ea1ffbc9-9994-4861-9d92-9fc475ce236f service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updated VIF entry in instance network info cache for port 02c1f98d-e7ae-4afb-a56a-35cf0b0050ff. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG nova.network.neutron [req-2f75c669-a4ff-4913-8a10-cf9438d157c0 req-ea1ffbc9-9994-4861-9d92-9fc475ce236f service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updating instance_info_cache with network_info: [{"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2f75c669-a4ff-4913-8a10-cf9438d157c0 req-ea1ffbc9-9994-4861-9d92-9fc475ce236f service nova] Releasing lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:31:18 user nova-compute[73627]: INFO nova.compute.manager [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] instance snapshotting
Aug 26 16:31:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyvAtonl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c437818f-4799-4ad9-8463-f798c768cae9', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4a076ad-efdc-40aa-9479-b4b513c765b6', 'serial': 'e4a076ad-efdc-40aa-9479-b4b513c765b6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikecaqHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'c437818f-4799-4ad9-8463-f798c768cae9', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac20d5e4-7cde-484f-a67a-bacecf961af9', 'serial'} {{(pid=73627) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyvAtonl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:18 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:18 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:18 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b83d442-f803-458b-942e-b7c76c48503b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:31:18 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:18 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Beginning live snapshot process
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78ea97b-7c13-4ee6-9bca-97b7e6ed0c0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6] added
Aug 26 16:31:18 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9379e95b-42e4-4265-a131-ddc46b1b89c5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[71493dfc-a97b-4dbb-aa2e-ce763f4434b7]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyvAtonl {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyvAtonl" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dc51af-a7bc-4abb-bd43-9b267def3bc3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HyvAtonl'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5f574f-97f5-4cd9-8815-cb7d36eda988]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde53c20-9bec-4a51-bad3-ddbea075abca]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json -f qcow2 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[be41b9c4-c312-4724-a295-c5c1ec0f3fd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6, portal: 172.16.0.220,3260]
Aug 26 16:31:18 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6, portal: 172.16.0.220,3260] successful.
Aug 26 16:31:18 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48356f5-69f9-4c43-aa6b-4983e8ad9875]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[000eff75-d0d5-459d-984f-ea22882127d0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:18 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[581e1a9f-1644-4740-9139-914d66795880]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyvAtonl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json -f qcow2 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptgvfay_m/40d6bd08ba334feeaf85b4fd40279a24.delta 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptgvfay_m/40d6bd08ba334feeaf85b4fd40279a24.delta 1073741824" returned: 0 in 0.050s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 16:31:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23633303836363939', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633303836363939', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:31:19 user nova-compute[73627]: DEBUG nova.objects.instance [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lazy-loading 'flavor' on Instance uuid c437818f-4799-4ad9-8463-f798c768cae9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] COPY block job progress, current cursor: 26673152 final cursor: 75497472 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 40894464 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:21 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:21 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 16:31:21 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:31:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptgvfay_m/40d6bd08ba334feeaf85b4fd40279a24.delta /opt/stack/data/nova/instances/snapshots/tmptgvfay_m/40d6bd08ba334feeaf85b4fd40279a24 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:21 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 177209344 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptgvfay_m/40d6bd08ba334feeaf85b4fd40279a24.delta /opt/stack/data/nova/instances/snapshots/tmptgvfay_m/40d6bd08ba334feeaf85b4fd40279a24" returned: 0 in 0.514s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:21 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Snapshot extracted, beginning image upload
Aug 26 16:31:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 313524224 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 459276288 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 639631360 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 807403520 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 903872512 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikecaqHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:24 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb41d6d-1f4c-4b1e-a83b-69eb37cc1e41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:24 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Snapshot image upload complete
Aug 26 16:31:24 user nova-compute[73627]: INFO nova.compute.manager [None req-5501ccd5-6a37-471e-b78f-2f8c0205806e tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Took 6.23 seconds to snapshot the instance on the hypervisor.
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bfc25f-e8d7-46b8-a1b2-46c44150a5f1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:24 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:24 user nova-compute[73627]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:24 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:24 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:24 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:24 user nova-compute[73627]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:24 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:24 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d07dc670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9'): ({'sde'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Removing single pathed devices sde {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ed8708-2200-4248-886b-ec7e32d257af]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ccfb18-e517-4d80-851f-7f9249505952]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Flushing IO for device /dev/sde {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4c5ebd-925b-4bd1-ada6-5e8f1e9d20a3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[998ac126-8784-47a5-9eec-f6441f34761a]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e05d18-a143-44ef-95cf-e4497dbbcf9b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfddbd76-feb2-4a06-8090-94748e4d432f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260]
Aug 26 16:31:24 user nova-compute[73627]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260] successful.
Aug 26 16:31:24 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dcea59-5d3f-4637-b279-da6710fa1f90]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] <== disconnect_volume: return (343ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:31:25 user nova-compute[73627]: DEBUG nova.compute.manager [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyvAtonl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c437818f-4799-4ad9-8463-f798c768cae9', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4a076ad-efdc-40aa-9479-b4b513c765b6', 'serial'} {{(pid=73627) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 16:31:25 user nova-compute[73627]: DEBUG nova.compute.manager [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] swap_volume: removing Cinder connection for volume ac20d5e4-7cde-484f-a67a-bacecf961af9 {{(pid=73627) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 16:31:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:25 user nova-compute[73627]: DEBUG nova.compute.manager [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] swap_volume: Updating volume ac20d5e4-7cde-484f-a67a-bacecf961af9 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "HyvAtonl", "auth_password": "CUWcydh1jq3rgZ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "e4a076ad-efdc-40aa-9479-b4b513c765b6"}, "status": "reserved", "instance": "c437818f-4799-4ad9-8463-f798c768cae9", "attached_at": "", "detached_at": "", "volume_id": "e4a076ad-efdc-40aa-9479-b4b513c765b6", "serial": "e4a076ad-efdc-40aa-9479-b4b513c765b6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e4a076ad-efdc-40aa-9479-b4b513c765b6', 'no_device': None, 'attachment_id': 'eedcc83b-1c74-4236-8bc8-da302d5a0a78'} {{(pid=73627) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 16:31:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2ed6b266-f519-4a73-9ee1-49a8c9e2cbbb tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "c437818f-4799-4ad9-8463-f798c768cae9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.426s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "c437818f-4799-4ad9-8463-f798c768cae9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG os_brick.utils [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b64716b-d3cb-466f-ba75-9e0b3687b8d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[990c4b37-e855-4469-80a6-c9da0f54504f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ede5f7-4d09-4aeb-9618-09548dcb4fce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30354d4-589a-43a3-8d87-f312ad707baf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-0fdf64a5-922d-4f93-9082-e58022643811 req-a9b1da6f-b07d-476c-9ff3-d0128c466b3b service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-changed-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-0fdf64a5-922d-4f93-9082-e58022643811 req-a9b1da6f-b07d-476c-9ff3-d0128c466b3b service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Refreshing instance network info cache due to event network-changed-9c451176-da07-49b3-8a14-03f62ec16298. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0fdf64a5-922d-4f93-9082-e58022643811 req-a9b1da6f-b07d-476c-9ff3-d0128c466b3b service nova] Acquiring lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0fdf64a5-922d-4f93-9082-e58022643811 req-a9b1da6f-b07d-476c-9ff3-d0128c466b3b service nova] Acquired lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG nova.network.neutron [req-0fdf64a5-922d-4f93-9082-e58022643811 req-a9b1da6f-b07d-476c-9ff3-d0128c466b3b service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Refreshing network info cache for port 9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:31:27 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55cdc7c-3e8a-4d60-8dc8-2f3e74ff48f8]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG os_brick.utils [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:27 user nova-compute[73627]: INFO nova.compute.manager [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Swapping volume e4a076ad-efdc-40aa-9479-b4b513c765b6 for ac20d5e4-7cde-484f-a67a-bacecf961af9
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG nova.objects.instance [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lazy-loading 'flavor' on Instance uuid 19c82f60-3294-4a09-96a3-b03a1673149c {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:28 user nova-compute[73627]: INFO nova.compute.manager [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Attaching volume fddd40a9-9db0-4b60-b9a1-ed534dac70a9 to /dev/vdb
Aug 26 16:31:28 user nova-compute[73627]: DEBUG os_brick.utils [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de44f59-e818-4b72-a1a2-9e2987bedb8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0a2e9f-8700-4633-b6c4-1732e4b22641]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb3248f-b214-4226-9eb8-69cab3888b3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ad0894-bd28-4254-a096-ad9149b8d2e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:31:28 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee692e4-469d-4641-a438-4c28257fd067]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG os_brick.utils [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating existing volume attachment record: d1a7bf9c-5ba5-4c2d-b8d3-8f4f241894ed {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG nova.network.neutron [req-0fdf64a5-922d-4f93-9082-e58022643811 req-a9b1da6f-b07d-476c-9ff3-d0128c466b3b service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updated VIF entry in instance network info cache for port 9c451176-da07-49b3-8a14-03f62ec16298. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG nova.network.neutron [req-0fdf64a5-922d-4f93-9082-e58022643811 req-a9b1da6f-b07d-476c-9ff3-d0128c466b3b service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updating instance_info_cache with network_info: [{"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:31:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0fdf64a5-922d-4f93-9082-e58022643811 req-a9b1da6f-b07d-476c-9ff3-d0128c466b3b service nova] Releasing lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikecaqHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c437818f-4799-4ad9-8463-f798c768cae9', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac20d5e4-7cde-484f-a67a-bacecf961af9', 'serial': 'ac20d5e4-7cde-484f-a67a-bacecf961af9'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyvAtonl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'e4a076ad-efdc-40aa-9479-b4b513c765b6'}, 'status': 'reserved', 'instance': 'c437818f-4799-4ad9-8463-f798c768cae9', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4a076ad-efdc-40aa-9479-b4b513c765b6', 'serial'} {{(pid=73627) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikecaqHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:39 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:39 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:39 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f941dc2-f891-4b74-a7b5-307512771eb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:31:39 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef18801-3b77-434f-8bb1-f76bb61cb4e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9] added
Aug 26 16:31:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a02b39-dc40-4871-a94b-90965745d505]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[534eacdc-99d1-40af-b5fe-2115a7e11faf]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikecaqHP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikecaqHP" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e18fe7f-4dd2-4e32-894b-d0db931c4ff5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ikecaqHP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba51f33e-6ee5-4cb1-8705-c36325961509]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd38cc11-9f33-4ab8-984f-7660faaaabe2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf21551-bfd6-4bc5-bf21-712e37c6bcb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260]
Aug 26 16:31:39 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260] successful.
Aug 26 16:31:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a3b8a3-f737-4ddd-b8dd-ced0c1441588]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14ca404-904a-45a5-920a-fce7ca2d49c8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da798e0-c7ef-444a-98cd-2a485d4a8d57]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikecaqHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:31:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfRpZHCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:40 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23362366430646635', 'path': '/dev/sde'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362366430646635', 'path': '/dev/sde'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.562s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:40 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:40 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG nova.objects.instance [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lazy-loading 'flavor' on Instance uuid c437818f-4799-4ad9-8463-f798c768cae9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5561fd1d-d7c6-4623-bd85-48508b407cbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:31:40 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d505720c-6e24-480b-966f-871e10d718e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9] added
Aug 26 16:31:40 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[936db2e4-82b6-420b-a20d-8558d64788d4]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c39f449-cfa6-45a8-8ff7-3fdc57156458]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfRpZHCb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfRpZHCb" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ab572d-ffa9-46fa-b46c-62beea0c8dd4]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfRpZHCb'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7998884-b578-4665-87ff-375977ff3bc5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b626e5-ba9e-4f39-bfd0-9c5a7b92da62]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dace145-efaa-4088-b9ed-b910fb3d27d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]
Aug 26 16:31:40 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.
Aug 26 16:31:40 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd47f3e8-c645-458f-a3aa-6235465d8b93]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec37b0d-31ee-4151-8b6b-6e381c37cbaf]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:31:40 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6704ed1a-eb04-4b05-845e-7f53f06c6d11]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:40 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:31:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 131072000 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:41 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:31:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfRpZHCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:31:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] <== connect_volume: return (1899ms) {'type': 'block', 'scsi_wwn': '26566343533333963', 'path': '/dev/sdf'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566343533333963', 'path': '/dev/sdf'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:31:41 user nova-compute[73627]: DEBUG nova.objects.instance [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lazy-loading 'flavor' on Instance uuid 19c82f60-3294-4a09-96a3-b03a1673149c {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:31:41 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:31:41 user nova-compute[73627]:   <source dev="/dev/sdf"/>
Aug 26 16:31:41 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:31:41 user nova-compute[73627]:   <serial>fddd40a9-9db0-4b60-b9a1-ed534dac70a9</serial>
Aug 26 16:31:41 user nova-compute[73627]: </disk>
Aug 26 16:31:41 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:31:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 240123904 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:31:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:31:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] No VIF found with MAC fa:16:3e:4a:53:d2, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:31:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 414187520 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f744ca01-fca6-47a4-8c25-f63beb12fe29 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.437s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 579862528 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 722468864 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 896532480 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 1028653056 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyvAtonl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'e4a076ad-efdc-40aa-9479-b4b513c765b6'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:45 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d07d746-f212-47f9-a773-36795593e381]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6ebe35-4624-461c-b24f-c14625e79bf5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:45 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:45 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:45 user nova-compute[73627]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:45 user nova-compute[73627]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:31:45 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:45 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:45 user nova-compute[73627]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 (non-flash)
Aug 26 16:31:45 user nova-compute[73627]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:45 user nova-compute[73627]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:31:45 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e816dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d513438-2650-40c6-bf77-cd5f4c519c31]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[48756193-58c0-4bb2-9386-d8f941128142]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d54d593-befe-4545-ba4c-99181c1940cb]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34b80e8-bf00-40dc-bb43-5536c8243a52]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fa1668-15d3-4510-b25a-a85388c7257d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76a2380-0996-4ad3-a6b8-a9fcf194913b]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6, portal: 172.16.0.220,3260]
Aug 26 16:31:45 user nova-compute[73627]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6, portal: 172.16.0.220,3260] successful.
Aug 26 16:31:45 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a076ad-efdc-40aa-9479-b4b513c765b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77cba03-eb00-4984-ba54-1b2e51739c23]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] <== disconnect_volume: return (325ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Stashing vm_state: active {{(pid=73627) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikecaqHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'c437818f-4799-4ad9-8463-f798c768cae9', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac20d5e4-7cde-484f-a67a-bacecf961af9', 'serial'} {{(pid=73627) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] swap_volume: removing Cinder connection for volume e4a076ad-efdc-40aa-9479-b4b513c765b6 {{(pid=73627) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:45 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:31:45 user nova-compute[73627]: INFO nova.compute.claims [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Claim successful on node user
Aug 26 16:31:45 user nova-compute[73627]: INFO nova.compute.resource_tracker [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating resource usage from migration 5b23a0b4-13c9-4c33-b0e9-6ab6fc0dffb7
Aug 26 16:31:46 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.481s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:46 user nova-compute[73627]: INFO nova.compute.manager [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Migrating
Aug 26 16:31:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:46 user nova-compute[73627]: INFO nova.compute.rpcapi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 26 16:31:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquired lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG nova.compute.manager [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] [instance: c437818f-4799-4ad9-8463-f798c768cae9] swap_volume: Updating volume e4a076ad-efdc-40aa-9479-b4b513c765b6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "ikecaqHP", "auth_password": "oV85dBQEgPi13M", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "ac20d5e4-7cde-484f-a67a-bacecf961af9"}, "status": "reserved", "instance": "c437818f-4799-4ad9-8463-f798c768cae9", "attached_at": "", "detached_at": "", "volume_id": "ac20d5e4-7cde-484f-a67a-bacecf961af9", "serial": "ac20d5e4-7cde-484f-a67a-bacecf961af9"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ac20d5e4-7cde-484f-a67a-bacecf961af9', 'no_device': None, 'attachment_id': '884f05ee-e763-4783-b2e3-5ed33298b027'} {{(pid=73627) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-632aaf77-cd7a-4c7b-936c-75eec7e6545a tempest-TestVolumeSwap-1227979890 tempest-TestVolumeSwap-1227979890-project-admin] Lock "c437818f-4799-4ad9-8463-f798c768cae9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.948s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating instance_info_cache with network_info: [{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Releasing lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:46 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Starting migrate_disk_and_power_off {{(pid=73627) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:31:47 user nova-compute[73627]: INFO nova.compute.claims [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Claim successful on node user
Aug 26 16:31:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:47 user nova-compute[73627]: INFO nova.compute.manager [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Detaching volume ac20d5e4-7cde-484f-a67a-bacecf961af9
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-e19c1b10-01bf-4848-b615-f8a84f980dfa req-81146605-0ce8-4fee-9b36-0c58677f0c60 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-unplugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e19c1b10-01bf-4848-b615-f8a84f980dfa req-81146605-0ce8-4fee-9b36-0c58677f0c60 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e19c1b10-01bf-4848-b615-f8a84f980dfa req-81146605-0ce8-4fee-9b36-0c58677f0c60 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e19c1b10-01bf-4848-b615-f8a84f980dfa req-81146605-0ce8-4fee-9b36-0c58677f0c60 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-e19c1b10-01bf-4848-b615-f8a84f980dfa req-81146605-0ce8-4fee-9b36-0c58677f0c60 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-unplugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:31:47 user nova-compute[73627]: WARNING nova.compute.manager [req-e19c1b10-01bf-4848-b615-f8a84f980dfa req-81146605-0ce8-4fee-9b36-0c58677f0c60 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received unexpected event network-vif-unplugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with vm_state active and task_state resize_migrating.
Aug 26 16:31:47 user nova-compute[73627]: INFO nova.virt.block_device [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Attempting to driver detach volume ac20d5e4-7cde-484f-a67a-bacecf961af9 from mountpoint /dev/vdb
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Attempting to detach device vdb from instance c437818f-4799-4ad9-8463-f798c768cae9 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:31:47 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:31:47 user nova-compute[73627]:   <source dev="/dev/sde"/>
Aug 26 16:31:47 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:31:47 user nova-compute[73627]:   <serial>ac20d5e4-7cde-484f-a67a-bacecf961af9</serial>
Aug 26 16:31:47 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:31:47 user nova-compute[73627]: </disk>
Aug 26 16:31:47 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:31:47 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Successfully detached device vdb from instance c437818f-4799-4ad9-8463-f798c768cae9 from the persistent domain config.
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c437818f-4799-4ad9-8463-f798c768cae9 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:31:47 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:31:47 user nova-compute[73627]:   <source dev="/dev/sde"/>
Aug 26 16:31:47 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:31:47 user nova-compute[73627]:   <serial>ac20d5e4-7cde-484f-a67a-bacecf961af9</serial>
Aug 26 16:31:47 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:31:47 user nova-compute[73627]: </disk>
Aug 26 16:31:47 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:31:47 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.policy [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acdf029015a64f89aa51e6559e0f962c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6269e1e9de40b5a5b295651a6fd9b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:31:47 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Creating image(s)
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "/opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.007s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067508.033228, c437818f-4799-4ad9-8463-f798c768cae9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c437818f-4799-4ad9-8463-f798c768cae9 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:31:48 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Successfully detached device vdb from instance c437818f-4799-4ad9-8463-f798c768cae9 from the live domain config.
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikecaqHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'ac20d5e4-7cde-484f-a67a-bacecf961af9'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:48 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance destroyed successfully.
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1150395174',display_name='tempest-ServerActionsTestOtherB-server-1150395174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1150395174',id=19,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsMLcp+BUGxkTU5eO6A9fURs5JKJUKrz971vfnvzmwjrONPq4qpNUgYZ+CzdRhMT1bKtdKKOR19LocoMu/yIF+ku4vNBbvF97/+zoHaRx1dCCz3qB4DhdvvVw1Om3Llw==',key_name='tempest-keypair-646039968',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dc034dfcf2a3437b9b505fc54cd014a6',ramdisk_id='',reservation_id='r-c0b38pf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1300226985',owner_user_name='tempest-ServerActionsTestOtherB-1300226985-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d633720332174fe9a29c1b7775698982',uuid=19c82f60-3294-4a09-96a3-b03a1673149c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-337726789-network", "vif_mac": "fa:16:3e:4a:53:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converting VIF {"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-337726789-network", "vif_mac": "fa:16:3e:4a:53:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_vif [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae911fbe-6a, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.199s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[728d834a-0bf1-4eff-8109-7aefc57cbe06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: INFO os_vif [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a')
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfRpZHCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:48 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dc57e4-0f44-42c1-804a-2b777522c704]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d04b0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9'): ({'sde'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Removing single pathed devices sde {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[046a3713-c0e6-4d78-ae71-cbac3bf5133b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6720aad-b076-4b92-8a1c-15e01d555d24]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Flushing IO for device /dev/sde {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[504bb4e8-46a8-418e-a137-a5a809b09955]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc9b0bb-3587-4478-a4ea-d441f3e3b66c]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.207s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c60b5e6-f69a-42ce-a541-261541fcad70]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk 1073741824" returned: 0 in 0.050s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b3d6e0-89f1-4225-91ab-40fdee6c4e42]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260]
Aug 26 16:31:48 user nova-compute[73627]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9, portal: 172.16.0.220,3260] successful.
Aug 26 16:31:48 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac20d5e4-7cde-484f-a67a-bacecf961af9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf4a572-3737-42b8-8671-9b0d24fc4195]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] <== disconnect_volume: return (394ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.309s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[370d5ad9-3b88-450e-908a-94f22215b88a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[814ec802-c59d-4126-8cc4-b36e5c8dd795]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:31:48 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d04b2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9'): ({'sdf'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Removing single pathed devices sdf {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3743d8dd-cb14-472e-b241-1b57645b2613]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Successfully created port: 6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ea425a-e577-4a10-bc7b-33fe422583e5]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Flushing IO for device /dev/sdf {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.246s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Checking if we can resize image /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d4fa6e-3244-4a91-b072-0ae8ebd859e8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.061s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a3365-7723-400d-911e-2f8477e3e7ab]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] SCSI volumes sdf have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[373b07b0-bcc6-49c5-8a62-ee44fdd3d2cc]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccd6505-8f06-400e-8463-8f5df0fdbaa7]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]
Aug 26 16:31:48 user nova-compute[73627]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.
Aug 26 16:31:48 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Cannot resize image /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Ensure instance console log exists: /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[940395ac-d2b5-46b6-be52-d0098246dbdd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] <== disconnect_volume: return (674ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:31:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c_resize/disk /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.objects.instance [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lazy-loading 'flavor' on Instance uuid c437818f-4799-4ad9-8463-f798c768cae9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-11cb6821-1ae4-4c94-ad5c-35f8bff27e9f tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.082s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Successfully updated port: 6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-f45328ea-0c2a-4747-b7c7-3f967d8db70e req-46ddad82-d7c1-4e46-953f-440b66992619 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f45328ea-0c2a-4747-b7c7-3f967d8db70e req-46ddad82-d7c1-4e46-953f-440b66992619 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f45328ea-0c2a-4747-b7c7-3f967d8db70e req-46ddad82-d7c1-4e46-953f-440b66992619 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f45328ea-0c2a-4747-b7c7-3f967d8db70e req-46ddad82-d7c1-4e46-953f-440b66992619 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-f45328ea-0c2a-4747-b7c7-3f967d8db70e req-46ddad82-d7c1-4e46-953f-440b66992619 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:31:49 user nova-compute[73627]: WARNING nova.compute.manager [req-f45328ea-0c2a-4747-b7c7-3f967d8db70e req-46ddad82-d7c1-4e46-953f-440b66992619 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received unexpected event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with vm_state active and task_state resize_migrating.
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquired lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "cp -r /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c_resize/disk /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk" returned: 0 in 0.381s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c_resize/disk.info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk.info {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "cp -r /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c_resize/disk.info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk.info" returned: 0 in 0.033s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updating instance_info_cache with network_info: [{"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Releasing lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Instance network_info: |[{"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Start _get_guest_xml network_info=[{"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:31:49 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:31:49 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:31:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1675444985',display_name='tempest-ServerRescueNegativeTestJSON-server-1675444985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1675444985',id=27,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9oNjx+q/f0Zsfa9d+owmTwOfPxnAFIujBDOcAHpLpFBrMTb/9AuaTtdHxoyI837Zw0tIQiWWvz1WlumzmI3vcf2OAhWTK61Gwy/QsE2gdYqKqsvpsyXP7S8DW5XQHJNw==',key_name='tempest-keypair-801950324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-0j9wi7yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:31:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acdf029015a64f89aa51e6559e0f962c',uuid=daca1645-10d4-45e7-874a-b2972a494e6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:33:56,bridge_name='br-int',has_traffic_filtering=True,id=6757dac8-c193-43e9-88cd-c4ac4d551120,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6757dac8-c1') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'pci_devices' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:31:49 user nova-compute[73627]:   <uuid>daca1645-10d4-45e7-874a-b2972a494e6e</uuid>
Aug 26 16:31:49 user nova-compute[73627]:   <name>instance-0000001b</name>
Aug 26 16:31:49 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:31:49 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:31:49 user nova-compute[73627]:   <metadata>
Aug 26 16:31:49 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:31:49 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:31:49 user nova-compute[73627]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1675444985</nova:name>
Aug 26 16:31:49 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:31:49</nova:creationTime>
Aug 26 16:31:49 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:31:49 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:31:49 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:31:49 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:31:49 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:31:49 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:31:49 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:31:49 user nova-compute[73627]:       <nova:owner>
Aug 26 16:31:49 user nova-compute[73627]:         <nova:user uuid="acdf029015a64f89aa51e6559e0f962c">tempest-ServerRescueNegativeTestJSON-1187038007-project-member</nova:user>
Aug 26 16:31:49 user nova-compute[73627]:         <nova:project uuid="9f6269e1e9de40b5a5b295651a6fd9b3">tempest-ServerRescueNegativeTestJSON-1187038007</nova:project>
Aug 26 16:31:49 user nova-compute[73627]:       </nova:owner>
Aug 26 16:31:49 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:31:49 user nova-compute[73627]:       <nova:ports>
Aug 26 16:31:49 user nova-compute[73627]:         <nova:port uuid="6757dac8-c193-43e9-88cd-c4ac4d551120">
Aug 26 16:31:49 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 16:31:49 user nova-compute[73627]:         </nova:port>
Aug 26 16:31:49 user nova-compute[73627]:       </nova:ports>
Aug 26 16:31:49 user nova-compute[73627]:     </nova:instance>
Aug 26 16:31:49 user nova-compute[73627]:   </metadata>
Aug 26 16:31:49 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:31:49 user nova-compute[73627]:     <system>
Aug 26 16:31:49 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:31:49 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:31:49 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:31:49 user nova-compute[73627]:       <entry name="serial">daca1645-10d4-45e7-874a-b2972a494e6e</entry>
Aug 26 16:31:49 user nova-compute[73627]:       <entry name="uuid">daca1645-10d4-45e7-874a-b2972a494e6e</entry>
Aug 26 16:31:49 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:31:49 user nova-compute[73627]:     </system>
Aug 26 16:31:49 user nova-compute[73627]:   </sysinfo>
Aug 26 16:31:49 user nova-compute[73627]:   <os>
Aug 26 16:31:49 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:31:49 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:31:49 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:31:49 user nova-compute[73627]:   </os>
Aug 26 16:31:49 user nova-compute[73627]:   <features>
Aug 26 16:31:49 user nova-compute[73627]:     <acpi/>
Aug 26 16:31:49 user nova-compute[73627]:     <apic/>
Aug 26 16:31:49 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:31:49 user nova-compute[73627]:   </features>
Aug 26 16:31:49 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:31:49 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:31:49 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:31:49 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:31:49 user nova-compute[73627]:   </clock>
Aug 26 16:31:49 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:31:49 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:31:49 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:31:49 user nova-compute[73627]:   </cpu>
Aug 26 16:31:49 user nova-compute[73627]:   <devices>
Aug 26 16:31:49 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:31:49 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:31:49 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk"/>
Aug 26 16:31:49 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:31:49 user nova-compute[73627]:     </disk>
Aug 26 16:31:49 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:31:49 user nova-compute[73627]:       <mac address="fa:16:3e:3c:33:56"/>
Aug 26 16:31:49 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:31:49 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:31:49 user nova-compute[73627]:       <target dev="tap6757dac8-c1"/>
Aug 26 16:31:49 user nova-compute[73627]:     </interface>
Aug 26 16:31:49 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:31:49 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/console.log" append="off"/>
Aug 26 16:31:49 user nova-compute[73627]:     </serial>
Aug 26 16:31:49 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:31:49 user nova-compute[73627]:     <video>
Aug 26 16:31:49 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:31:49 user nova-compute[73627]:     </video>
Aug 26 16:31:49 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:31:49 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:31:49 user nova-compute[73627]:     </rng>
Aug 26 16:31:49 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:31:49 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:31:49 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:31:49 user nova-compute[73627]:     </memballoon>
Aug 26 16:31:49 user nova-compute[73627]:   </devices>
Aug 26 16:31:49 user nova-compute[73627]: </domain>
Aug 26 16:31:49 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:31:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1675444985',display_name='tempest-ServerRescueNegativeTestJSON-server-1675444985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1675444985',id=27,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9oNjx+q/f0Zsfa9d+owmTwOfPxnAFIujBDOcAHpLpFBrMTb/9AuaTtdHxoyI837Zw0tIQiWWvz1WlumzmI3vcf2OAhWTK61Gwy/QsE2gdYqKqsvpsyXP7S8DW5XQHJNw==',key_name='tempest-keypair-801950324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-0j9wi7yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:31:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acdf029015a64f89aa51e6559e0f962c',uuid=daca1645-10d4-45e7-874a-b2972a494e6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:33:56,bridge_name='br-int',has_traffic_filtering=True,id=6757dac8-c193-43e9-88cd-c4ac4d551120,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6757dac8-c1') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG os_vif [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:33:56,bridge_name='br-int',has_traffic_filtering=True,id=6757dac8-c193-43e9-88cd-c4ac4d551120,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6757dac8-c1') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6757dac8-c1, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6757dac8-c1, col_values=(('external_ids', {'iface-id': '6757dac8-c193-43e9-88cd-c4ac4d551120', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:33:56', 'vm-uuid': 'daca1645-10d4-45e7-874a-b2972a494e6e'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:49 user nova-compute[73627]: INFO os_vif [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:33:56,bridge_name='br-int',has_traffic_filtering=True,id=6757dac8-c193-43e9-88cd-c4ac4d551120,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6757dac8-c1')
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:31:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No VIF found with MAC fa:16:3e:3c:33:56, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:31:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:50 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Port ae911fbe-6ac5-4ef1-8224-47806a42627b binding to destination host user is already ACTIVE {{(pid=73627) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 16:31:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquired lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:50 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-76cee93f-390a-4c63-a8b0-54f3bd0039eb req-34bd3a28-c9da-4be3-b1bd-d1163307d95a service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-changed-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-76cee93f-390a-4c63-a8b0-54f3bd0039eb req-34bd3a28-c9da-4be3-b1bd-d1163307d95a service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Refreshing instance network info cache due to event network-changed-6757dac8-c193-43e9-88cd-c4ac4d551120. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-76cee93f-390a-4c63-a8b0-54f3bd0039eb req-34bd3a28-c9da-4be3-b1bd-d1163307d95a service nova] Acquiring lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-76cee93f-390a-4c63-a8b0-54f3bd0039eb req-34bd3a28-c9da-4be3-b1bd-d1163307d95a service nova] Acquired lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG nova.network.neutron [req-76cee93f-390a-4c63-a8b0-54f3bd0039eb req-34bd3a28-c9da-4be3-b1bd-d1163307d95a service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Refreshing network info cache for port 6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating instance_info_cache with network_info: [{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Releasing lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG os_brick.utils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5aa2b3-4b32-42f3-8037-d196440569ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ed24e3-1e2d-4dc7-b3fe-e2fd3734ddca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3021ea-ae51-4aed-9ecb-dc6260b4bf9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f3f237-1148-4dd6-8c6c-0bb934f65617]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG nova.network.neutron [req-76cee93f-390a-4c63-a8b0-54f3bd0039eb req-34bd3a28-c9da-4be3-b1bd-d1163307d95a service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updated VIF entry in instance network info cache for port 6757dac8-c193-43e9-88cd-c4ac4d551120. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:31:51 user nova-compute[73627]: DEBUG nova.network.neutron [req-76cee93f-390a-4c63-a8b0-54f3bd0039eb req-34bd3a28-c9da-4be3-b1bd-d1163307d95a service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updating instance_info_cache with network_info: [{"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:31:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:31:52 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:31:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd24e63-4bec-4d73-a390-04bbbf69bbd2]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:31:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:31:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:31:52 user nova-compute[73627]: DEBUG os_brick.utils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-76cee93f-390a-4c63-a8b0-54f3bd0039eb req-34bd3a28-c9da-4be3-b1bd-d1163307d95a service nova] Releasing lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:52 user nova-compute[73627]: INFO nova.compute.manager [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Rescuing
Aug 26 16:31:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:31:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquired lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:31:52 user nova-compute[73627]: DEBUG nova.network.neutron [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.network.neutron [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Updating instance_info_cache with network_info: [{"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Releasing lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:31:53 user nova-compute[73627]: WARNING nova.compute.manager [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received unexpected event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with vm_state building and task_state spawning.
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:31:53 user nova-compute[73627]: WARNING nova.compute.manager [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received unexpected event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with vm_state building and task_state spawning.
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-unplugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-unplugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:31:53 user nova-compute[73627]: WARNING nova.compute.manager [req-68fe51ec-1c44-4f68-8acb-e3b382f51883 req-7f740804-e884-4b39-858e-c178b5df9ff3 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received unexpected event network-vif-unplugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with vm_state active and task_state rescuing.
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067513.668374, daca1645-10d4-45e7-874a-b2972a494e6e => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:31:53 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] VM Resumed (Lifecycle Event)
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:31:53 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Instance spawned successfully.
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:31:53 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067513.6718624, daca1645-10d4-45e7-874a-b2972a494e6e => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:31:53 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] VM Started (Lifecycle Event)
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:31:53 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:31:53 user nova-compute[73627]: INFO nova.compute.manager [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 26 16:31:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:31:53 user nova-compute[73627]: INFO nova.compute.manager [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Took 6.85 seconds to build instance.
Aug 26 16:31:53 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Instance destroyed successfully.
Aug 26 16:31:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4bb619d2-bc5e-433b-bf26-493fc4771508 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.086s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:53 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Attempting a stable device rescue
Aug 26 16:31:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73627) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 16:31:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Instance directory exists: not creating {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 16:31:54 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Creating image(s)
Aug 26 16:31:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "/opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "/opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "/opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:54 user nova-compute[73627]: DEBUG nova.objects.instance [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'trusted_certs' on Instance uuid 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "9f237936a0893760614b870dc4d948d24f7fb343" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "9f237936a0893760614b870dc4d948d24f7fb343" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343.part --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343.part --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG nova.virt.images [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] 26556d1b-f9c0-4931-a44f-c8266024e438 was qcow2, converting to raw {{(pid=73627) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343.part /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343.converted {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343.part /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343.converted" returned: 0 in 0.298s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343.converted --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-5ff4f4e9-f1ae-4789-9f2b-856cc5b1de62 req-c48bc82e-0922-4311-bbf9-811cefad587e service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5ff4f4e9-f1ae-4789-9f2b-856cc5b1de62 req-c48bc82e-0922-4311-bbf9-811cefad587e service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5ff4f4e9-f1ae-4789-9f2b-856cc5b1de62 req-c48bc82e-0922-4311-bbf9-811cefad587e service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5ff4f4e9-f1ae-4789-9f2b-856cc5b1de62 req-c48bc82e-0922-4311-bbf9-811cefad587e service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-5ff4f4e9-f1ae-4789-9f2b-856cc5b1de62 req-c48bc82e-0922-4311-bbf9-811cefad587e service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:31:55 user nova-compute[73627]: WARNING nova.compute.manager [req-5ff4f4e9-f1ae-4789-9f2b-856cc5b1de62 req-c48bc82e-0922-4311-bbf9-811cefad587e service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received unexpected event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with vm_state active and task_state rescuing.
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "9f237936a0893760614b870dc4d948d24f7fb343" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.779s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "9f237936a0893760614b870dc4d948d24f7fb343" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "9f237936a0893760614b870dc4d948d24f7fb343" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343 --force-share --output=json" returned: 0 in 0.194s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343,backing_fmt=raw /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.rescue {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343,backing_fmt=raw /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.rescue" returned: 0 in 0.055s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "9f237936a0893760614b870dc4d948d24f7fb343" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.objects.instance [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'migration_context' on Instance uuid 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.objects.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Object Instance<995309d1-3ec1-4ded-a2b5-5c359d2f3f48> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Start _get_guest_xml network_info=[{"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "vif_mac": "fa:16:3e:c5:9b:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '26556d1b-f9c0-4931-a44f-c8266024e438', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skaSoEfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '995309d1-3ec1-4ded-a2b5-5c359d2f3f48', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4', 'serial': 'e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4'}, 'guest_format': None, 'attachment_id': 'a783e0c9-e5cd-4e57-ac71-0909ccf1ac89', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.objects.instance [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'resources' on Instance uuid 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.objects.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Object Instance<995309d1-3ec1-4ded-a2b5-5c359d2f3f48> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.objects.instance [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'numa_topology' on Instance uuid 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.objects.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Object Instance<995309d1-3ec1-4ded-a2b5-5c359d2f3f48> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:31:56 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:31:56 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.objects.instance [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'vcpu_model' on Instance uuid 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.objects.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Object Instance<995309d1-3ec1-4ded-a2b5-5c359d2f3f48> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skaSoEfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:31:56 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:56 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:31:56 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16db251-8cd4-40ea-acc4-ee3aa9112d99]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = skaSoEfY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 16:31:56 user nova-compute[73627]: node.name = iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4
Aug 26 16:31:56 user nova-compute[73627]: node.tpgt = -1
Aug 26 16:31:56 user nova-compute[73627]: node.startup = automatic
Aug 26 16:31:56 user nova-compute[73627]: node.leading_login = No
Aug 26 16:31:56 user nova-compute[73627]: iface.iscsi_ifacename = default
Aug 26 16:31:56 user nova-compute[73627]: iface.net_ifacename = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.ipaddress = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.prefix_len = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.hwaddress = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.transport_name = tcp
Aug 26 16:31:56 user nova-compute[73627]: iface.initiatorname = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.state = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.vlan_id = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.vlan_priority = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.vlan_state = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.iface_num = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.mtu = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.port = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.bootproto = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.subnet_mask = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.gateway = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.dhcp_alt_client_id = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.dhcp_dns = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.dhcp_learn_iqn = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.dhcp_vendor_id_state = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.dhcp_vendor_id = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.dhcp_slp_da = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.fragmentation = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.gratuitous_arp = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.incoming_forwarding = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.tos_state = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.tos = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.ttl = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.delayed_ack = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.tcp_nagle = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.tcp_wsf_state = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.tcp_wsf = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.tcp_timer_scale = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.tcp_timestamp = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.redirect = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.def_task_mgmt_timeout = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.header_digest = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.data_digest = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.immediate_data = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.initial_r2t = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.data_seq_inorder = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.data_pdu_inorder = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.erl = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.max_receive_data_len = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.first_burst_len = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.max_outstanding_r2t = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.max_burst_len = 0
Aug 26 16:31:56 user nova-compute[73627]: iface.chap_auth = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.bidi_chap = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.strict_login_compliance = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.discovery_auth = <empty>
Aug 26 16:31:56 user nova-compute[73627]: iface.discovery_logout = <empty>
Aug 26 16:31:56 user nova-compute[73627]: node.discovery_address = <empty>
Aug 26 16:31:56 user nova-compute[73627]: node.discovery_port = 0
Aug 26 16:31:56 user nova-compute[73627]: node.discovery_type = static
Aug 26 16:31:56 user nova-compute[73627]: node.session.initial_cmdsn = 0
Aug 26 16:31:56 user nova-compute[73627]: node.session.initial_login_retry_max = 8
Aug 26 16:31:56 user nova-compute[73627]: node.session.xmit_thread_priority = -20
Aug 26 16:31:56 user nova-compute[73627]: node.session.cmds_max = 128
Aug 26 16:31:56 user nova-compute[73627]: node.session.queue_depth = 32
Aug 26 16:31:56 user nova-compute[73627]: node.session.nr_sessions = 1
Aug 26 16:31:56 user nova-compute[73627]: node.session.auth.authmethod = CHAP
Aug 26 16:31:56 user nova-compute[73627]: node.session.auth.username = skaSoEfY
Aug 26 16:31:56 user nova-compute[73627]: node.session.auth.password = ***
Aug 26 16:31:56 user nova-compute[73627]: node.session.auth.username_in = <empty>
Aug 26 16:31:56 user nova-compute[73627]: node.session.auth.password_in = <empty>
Aug 26 16:31:56 user nova-compute[73627]: node.session.auth.chap_algs = MD5
Aug 26 16:31:56 user nova-compute[73627]: node.session.timeo.replacement_timeout = 120
Aug 26 16:31:56 user nova-compute[73627]: node.session.err_timeo.abort_timeout = 15
Aug 26 16:31:56 user nova-compute[73627]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 16:31:56 user nova-compute[73627]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 16:31:56 user nova-compute[73627]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 16:31:56 user nova-compute[73627]: node.session.iscsi.FastAbort = Yes
Aug 26 16:31:56 user nova-compute[73627]: node.session.iscsi.InitialR2T = No
Aug 26 16:31:56 user nova-compute[73627]: node.session.iscsi.ImmediateData = Yes
Aug 26 16:31:56 user nova-compute[73627]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 16:31:56 user nova-compute[73627]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 16:31:56 user nova-compute[73627]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 16:31:56 user nova-compute[73627]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 16:31:56 user nova-compute[73627]: node.session.iscsi.MaxConnections = 1
Aug 26 16:31:56 user nova-compute[73627]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 16:31:56 user nova-compute[73627]: node.session.iscsi.ERL = 0
Aug 26 16:31:56 user nova-compute[73627]: node.session.scan = manual
Aug 26 16:31:56 user nova-compute[73627]: node.session.reopen_max = 0
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].address = 172.16.0.220
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].port = 3260
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].startup = manual
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].tcp.window_size = 524288
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].tcp.type_of_service = 0
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].timeo.logout_timeout = 15
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].timeo.login_timeout = 15
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].timeo.auth_timeout = 45
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].iscsi.DataDigest = None
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].iscsi.IFMarker = No
Aug 26 16:31:56 user nova-compute[73627]: node.conn[0].iscsi.OFMarker = No
Aug 26 16:31:56 user nova-compute[73627]: # END RECORD
Aug 26 16:31:56 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8810b14-e6c6-4d3a-828f-9cad627b2b84]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d968ef-d69f-4753-9d8b-4401a103564e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skaSoEfY {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skaSoEfY" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[97335c2f-652f-4e47-9761-6c18b36b955e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'skaSoEfY'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e007da4a-03c2-423e-87dc-8e7512888b2d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3853d20d-d8eb-4741-b058-16e005e8a417]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:56 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:56 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:31:56 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:31:56 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] HCTL ('35', '0', '0', 0) found on session 19 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc98255-60d8-4005-9afa-7990026eff6c]: (4, ('0 0 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Searching for a device in session 19 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skaSoEfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.208s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] <== connect_volume: return (210ms) {'type': 'block', 'scsi_wwn': '23539663435376136', 'path': '/dev/sdd'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539663435376136', 'path': '/dev/sdd'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-450066436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-450066436',id=25,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:30:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8b8b30c15b8423e90156082111b000f',ramdisk_id='',reservation_id='r-7s3q8pbq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:30:36Z,user_data=None,user_id='f24169ea97724e1288631ea977a068bd',uuid=995309d1-3ec1-4ded-a2b5-5c359d2f3f48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "vif_mac": "fa:16:3e:c5:9b:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converting VIF {"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "vif_mac": "fa:16:3e:c5:9b:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:9b:20,bridge_name='br-int',has_traffic_filtering=True,id=7252e98b-6ee2-4b47-a339-16612b95c731,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7252e98b-6e') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.objects.instance [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'pci_devices' on Instance uuid 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.objects.base [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Object Instance<995309d1-3ec1-4ded-a2b5-5c359d2f3f48> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:31:56 user nova-compute[73627]:   <uuid>995309d1-3ec1-4ded-a2b5-5c359d2f3f48</uuid>
Aug 26 16:31:56 user nova-compute[73627]:   <name>instance-00000019</name>
Aug 26 16:31:56 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:31:56 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:31:56 user nova-compute[73627]:   <metadata>
Aug 26 16:31:56 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:31:56 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:31:56 user nova-compute[73627]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-450066436</nova:name>
Aug 26 16:31:56 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:31:56</nova:creationTime>
Aug 26 16:31:56 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:31:56 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:31:56 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:31:56 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:31:56 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:31:56 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:31:56 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:31:56 user nova-compute[73627]:       <nova:owner>
Aug 26 16:31:56 user nova-compute[73627]:         <nova:user uuid="f24169ea97724e1288631ea977a068bd">tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member</nova:user>
Aug 26 16:31:56 user nova-compute[73627]:         <nova:project uuid="c8b8b30c15b8423e90156082111b000f">tempest-ServerBootFromVolumeStableRescueTest-2135030864</nova:project>
Aug 26 16:31:56 user nova-compute[73627]:       </nova:owner>
Aug 26 16:31:56 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:31:56 user nova-compute[73627]:       <nova:ports>
Aug 26 16:31:56 user nova-compute[73627]:         <nova:port uuid="7252e98b-6ee2-4b47-a339-16612b95c731">
Aug 26 16:31:56 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 16:31:56 user nova-compute[73627]:         </nova:port>
Aug 26 16:31:56 user nova-compute[73627]:       </nova:ports>
Aug 26 16:31:56 user nova-compute[73627]:     </nova:instance>
Aug 26 16:31:56 user nova-compute[73627]:   </metadata>
Aug 26 16:31:56 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:31:56 user nova-compute[73627]:     <system>
Aug 26 16:31:56 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:31:56 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:31:56 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:31:56 user nova-compute[73627]:       <entry name="serial">995309d1-3ec1-4ded-a2b5-5c359d2f3f48</entry>
Aug 26 16:31:56 user nova-compute[73627]:       <entry name="uuid">995309d1-3ec1-4ded-a2b5-5c359d2f3f48</entry>
Aug 26 16:31:56 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:31:56 user nova-compute[73627]:     </system>
Aug 26 16:31:56 user nova-compute[73627]:   </sysinfo>
Aug 26 16:31:56 user nova-compute[73627]:   <os>
Aug 26 16:31:56 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:31:56 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:31:56 user nova-compute[73627]:   </os>
Aug 26 16:31:56 user nova-compute[73627]:   <features>
Aug 26 16:31:56 user nova-compute[73627]:     <acpi/>
Aug 26 16:31:56 user nova-compute[73627]:     <apic/>
Aug 26 16:31:56 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:31:56 user nova-compute[73627]:   </features>
Aug 26 16:31:56 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:31:56 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:31:56 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:31:56 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:31:56 user nova-compute[73627]:   </clock>
Aug 26 16:31:56 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:31:56 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:31:56 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:31:56 user nova-compute[73627]:   </cpu>
Aug 26 16:31:56 user nova-compute[73627]:   <devices>
Aug 26 16:31:56 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:31:56 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:31:56 user nova-compute[73627]:       <source dev="/dev/sdd"/>
Aug 26 16:31:56 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:31:56 user nova-compute[73627]:       <serial>e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4</serial>
Aug 26 16:31:56 user nova-compute[73627]:     </disk>
Aug 26 16:31:56 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:31:56 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:31:56 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.rescue"/>
Aug 26 16:31:56 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:31:56 user nova-compute[73627]:       <boot order="1"/>
Aug 26 16:31:56 user nova-compute[73627]:     </disk>
Aug 26 16:31:56 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:31:56 user nova-compute[73627]:       <mac address="fa:16:3e:c5:9b:20"/>
Aug 26 16:31:56 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:31:56 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:31:56 user nova-compute[73627]:       <target dev="tap7252e98b-6e"/>
Aug 26 16:31:56 user nova-compute[73627]:     </interface>
Aug 26 16:31:56 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:31:56 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/console.log" append="off"/>
Aug 26 16:31:56 user nova-compute[73627]:     </serial>
Aug 26 16:31:56 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:31:56 user nova-compute[73627]:     <video>
Aug 26 16:31:56 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:31:56 user nova-compute[73627]:     </video>
Aug 26 16:31:56 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:31:56 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:31:56 user nova-compute[73627]:     </rng>
Aug 26 16:31:56 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:31:56 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:31:56 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:31:56 user nova-compute[73627]:     </memballoon>
Aug 26 16:31:56 user nova-compute[73627]:   </devices>
Aug 26 16:31:56 user nova-compute[73627]: </domain>
Aug 26 16:31:56 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:31:56 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Instance destroyed successfully.
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:31:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] No VIF found with MAC fa:16:3e:c5:9b:20, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:31:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-b5be764e-f7c5-41e0-8712-ad94926bb622 req-bac3a336-36d6-4aca-b804-0fd905801b93 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:31:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b5be764e-f7c5-41e0-8712-ad94926bb622 req-bac3a336-36d6-4aca-b804-0fd905801b93 service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:31:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b5be764e-f7c5-41e0-8712-ad94926bb622 req-bac3a336-36d6-4aca-b804-0fd905801b93 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:31:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b5be764e-f7c5-41e0-8712-ad94926bb622 req-bac3a336-36d6-4aca-b804-0fd905801b93 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:31:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-b5be764e-f7c5-41e0-8712-ad94926bb622 req-bac3a336-36d6-4aca-b804-0fd905801b93 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:31:58 user nova-compute[73627]: WARNING nova.compute.manager [req-b5be764e-f7c5-41e0-8712-ad94926bb622 req-bac3a336-36d6-4aca-b804-0fd905801b93 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received unexpected event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with vm_state active and task_state rescuing.
Aug 26 16:31:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:31:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Removed pending event for 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 due to event {{(pid=73627) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 16:32:00 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067520.2764046, 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:32:00 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] VM Resumed (Lifecycle Event)
Aug 26 16:32:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-70356ff3-0232-487b-808f-447aa814e329 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-4feb0d95-bd58-4cc9-9566-7cf27c7b4090 req-403d7105-db7c-42a9-b53c-d50defaf44b9 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4feb0d95-bd58-4cc9-9566-7cf27c7b4090 req-403d7105-db7c-42a9-b53c-d50defaf44b9 service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4feb0d95-bd58-4cc9-9566-7cf27c7b4090 req-403d7105-db7c-42a9-b53c-d50defaf44b9 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4feb0d95-bd58-4cc9-9566-7cf27c7b4090 req-403d7105-db7c-42a9-b53c-d50defaf44b9 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-4feb0d95-bd58-4cc9-9566-7cf27c7b4090 req-403d7105-db7c-42a9-b53c-d50defaf44b9 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:00 user nova-compute[73627]: WARNING nova.compute.manager [req-4feb0d95-bd58-4cc9-9566-7cf27c7b4090 req-403d7105-db7c-42a9-b53c-d50defaf44b9 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received unexpected event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with vm_state active and task_state rescuing.
Aug 26 16:32:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:32:00 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 16:32:00 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067520.2769327, 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:32:00 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] VM Started (Lifecycle Event)
Aug 26 16:32:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:32:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:03 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067508.0535867, 19c82f60-3294-4a09-96a3-b03a1673149c => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:32:03 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] VM Stopped (Lifecycle Event)
Aug 26 16:32:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cde3130a-d15f-40d9-ba2d-919c014cb582 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cde3130a-d15f-40d9-ba2d-919c014cb582 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:32:03 user nova-compute[73627]: INFO nova.compute.manager [None req-cde3130a-d15f-40d9-ba2d-919c014cb582 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 16:32:03 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:32:04 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:32:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:32:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Starting finish_migration {{(pid=73627) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance directory exists: not creating {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 16:32:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Creating image(s)
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.230s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk. size=21474836480 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk 21474836480 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk 21474836480" returned: 0 in 0.046s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Ensure instance console log exists: /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Start _get_guest_xml network_info=[{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-337726789-network", "vif_mac": "fa:16:3e:4a:53:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfRpZHCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '19c82f60-3294-4a09-96a3-b03a1673149c', 'attached_at': '2023-08-26T16:32:05.000000', 'detached_at': '', 'volume_id': 'fddd40a9-9db0-4b60-b9a1-ed534dac70a9', 'serial': 'fddd40a9-9db0-4b60-b9a1-ed534dac70a9'}, 'guest_format': None, 'attachment_id': '7eafd569-99d2-45ce-a225-f4485fcb7df6', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:05 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:32:05 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:17Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfRpZHCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:32:05 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:32:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:32:05 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:32:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:32:05 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db50964-828c-4d0a-8fe8-1ad8b3ffe7aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:32:05 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd19147-92fb-491e-a475-726ffdd650b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9] added
Aug 26 16:32:06 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[73682b2e-c528-4126-8059-2fe7dd42954d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb195f25-cfe5-4ee1-937f-8a4c75200df5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfRpZHCb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfRpZHCb" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f09ab4-607f-4151-a22e-1fd207db80bb]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfRpZHCb'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7579cf-86b3-4e43-864b-fe67068f67bc]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1253bdbd-f24e-4e8a-9ec8-526c19b73624]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:06 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:06 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:06 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:06 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[12793720-2c94-4bbe-b473-ba835e63d777]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]
Aug 26 16:32:06 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.
Aug 26 16:32:06 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe10909c-ba80-4001-9cb2-1a02150b0f0d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dc8fce-c82b-4a94-94af-e25b9a9ce3b0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:06 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:06 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:06 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:06 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:06 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:06 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[64da4787-78ae-406f-9f4a-514262eafe0d]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfRpZHCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '26566343533333963', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566343533333963', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1150395174',display_name='tempest-ServerActionsTestOtherB-server-1150395174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1150395174',id=19,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsMLcp+BUGxkTU5eO6A9fURs5JKJUKrz971vfnvzmwjrONPq4qpNUgYZ+CzdRhMT1bKtdKKOR19LocoMu/yIF+ku4vNBbvF97/+zoHaRx1dCCz3qB4DhdvvVw1Om3Llw==',key_name='tempest-keypair-646039968',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dc034dfcf2a3437b9b505fc54cd014a6',ramdisk_id='',reservation_id='r-c0b38pf9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1300226985',owner_user_name='tempest-ServerActionsTestOtherB-1300226985-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:31:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d633720332174fe9a29c1b7775698982',uuid=19c82f60-3294-4a09-96a3-b03a1673149c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-337726789-network", "vif_mac": "fa:16:3e:4a:53:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converting VIF {"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-337726789-network", "vif_mac": "fa:16:3e:4a:53:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:32:07 user nova-compute[73627]:   <uuid>19c82f60-3294-4a09-96a3-b03a1673149c</uuid>
Aug 26 16:32:07 user nova-compute[73627]:   <name>instance-00000013</name>
Aug 26 16:32:07 user nova-compute[73627]:   <memory>2097152</memory>
Aug 26 16:32:07 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:32:07 user nova-compute[73627]:   <metadata>
Aug 26 16:32:07 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:32:07 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:32:07 user nova-compute[73627]:       <nova:name>tempest-ServerActionsTestOtherB-server-1150395174</nova:name>
Aug 26 16:32:07 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:32:05</nova:creationTime>
Aug 26 16:32:07 user nova-compute[73627]:       <nova:flavor name="m1.small">
Aug 26 16:32:07 user nova-compute[73627]:         <nova:memory>2048</nova:memory>
Aug 26 16:32:07 user nova-compute[73627]:         <nova:disk>20</nova:disk>
Aug 26 16:32:07 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:32:07 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:32:07 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:32:07 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:32:07 user nova-compute[73627]:       <nova:owner>
Aug 26 16:32:07 user nova-compute[73627]:         <nova:user uuid="d633720332174fe9a29c1b7775698982">tempest-ServerActionsTestOtherB-1300226985-project-member</nova:user>
Aug 26 16:32:07 user nova-compute[73627]:         <nova:project uuid="dc034dfcf2a3437b9b505fc54cd014a6">tempest-ServerActionsTestOtherB-1300226985</nova:project>
Aug 26 16:32:07 user nova-compute[73627]:       </nova:owner>
Aug 26 16:32:07 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:32:07 user nova-compute[73627]:       <nova:ports>
Aug 26 16:32:07 user nova-compute[73627]:         <nova:port uuid="ae911fbe-6ac5-4ef1-8224-47806a42627b">
Aug 26 16:32:07 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 16:32:07 user nova-compute[73627]:         </nova:port>
Aug 26 16:32:07 user nova-compute[73627]:       </nova:ports>
Aug 26 16:32:07 user nova-compute[73627]:     </nova:instance>
Aug 26 16:32:07 user nova-compute[73627]:   </metadata>
Aug 26 16:32:07 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:32:07 user nova-compute[73627]:     <system>
Aug 26 16:32:07 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:32:07 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:32:07 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:32:07 user nova-compute[73627]:       <entry name="serial">19c82f60-3294-4a09-96a3-b03a1673149c</entry>
Aug 26 16:32:07 user nova-compute[73627]:       <entry name="uuid">19c82f60-3294-4a09-96a3-b03a1673149c</entry>
Aug 26 16:32:07 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:32:07 user nova-compute[73627]:     </system>
Aug 26 16:32:07 user nova-compute[73627]:   </sysinfo>
Aug 26 16:32:07 user nova-compute[73627]:   <os>
Aug 26 16:32:07 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:32:07 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:32:07 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:32:07 user nova-compute[73627]:   </os>
Aug 26 16:32:07 user nova-compute[73627]:   <features>
Aug 26 16:32:07 user nova-compute[73627]:     <acpi/>
Aug 26 16:32:07 user nova-compute[73627]:     <apic/>
Aug 26 16:32:07 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:32:07 user nova-compute[73627]:   </features>
Aug 26 16:32:07 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:32:07 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:32:07 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:32:07 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:32:07 user nova-compute[73627]:   </clock>
Aug 26 16:32:07 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:32:07 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:32:07 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:32:07 user nova-compute[73627]:   </cpu>
Aug 26 16:32:07 user nova-compute[73627]:   <devices>
Aug 26 16:32:07 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:32:07 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:32:07 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk"/>
Aug 26 16:32:07 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:32:07 user nova-compute[73627]:     </disk>
Aug 26 16:32:07 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:32:07 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:32:07 user nova-compute[73627]:       <source dev="/dev/sdc"/>
Aug 26 16:32:07 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:32:07 user nova-compute[73627]:       <serial>fddd40a9-9db0-4b60-b9a1-ed534dac70a9</serial>
Aug 26 16:32:07 user nova-compute[73627]:     </disk>
Aug 26 16:32:07 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:32:07 user nova-compute[73627]:       <mac address="fa:16:3e:4a:53:d2"/>
Aug 26 16:32:07 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:32:07 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:32:07 user nova-compute[73627]:       <target dev="tapae911fbe-6a"/>
Aug 26 16:32:07 user nova-compute[73627]:     </interface>
Aug 26 16:32:07 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:32:07 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/console.log" append="off"/>
Aug 26 16:32:07 user nova-compute[73627]:     </serial>
Aug 26 16:32:07 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:32:07 user nova-compute[73627]:     <video>
Aug 26 16:32:07 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:32:07 user nova-compute[73627]:     </video>
Aug 26 16:32:07 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:32:07 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:32:07 user nova-compute[73627]:     </rng>
Aug 26 16:32:07 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:32:07 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:32:07 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:32:07 user nova-compute[73627]:     </memballoon>
Aug 26 16:32:07 user nova-compute[73627]:   </devices>
Aug 26 16:32:07 user nova-compute[73627]: </domain>
Aug 26 16:32:07 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1150395174',display_name='tempest-ServerActionsTestOtherB-server-1150395174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1150395174',id=19,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsMLcp+BUGxkTU5eO6A9fURs5JKJUKrz971vfnvzmwjrONPq4qpNUgYZ+CzdRhMT1bKtdKKOR19LocoMu/yIF+ku4vNBbvF97/+zoHaRx1dCCz3qB4DhdvvVw1Om3Llw==',key_name='tempest-keypair-646039968',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dc034dfcf2a3437b9b505fc54cd014a6',ramdisk_id='',reservation_id='r-c0b38pf9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1300226985',owner_user_name='tempest-ServerActionsTestOtherB-1300226985-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:31:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d633720332174fe9a29c1b7775698982',uuid=19c82f60-3294-4a09-96a3-b03a1673149c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-337726789-network", "vif_mac": "fa:16:3e:4a:53:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converting VIF {"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-337726789-network", "vif_mac": "fa:16:3e:4a:53:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG os_vif [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae911fbe-6a, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae911fbe-6a, col_values=(('external_ids', {'iface-id': 'ae911fbe-6ac5-4ef1-8224-47806a42627b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:53:d2', 'vm-uuid': '19c82f60-3294-4a09-96a3-b03a1673149c'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:32:07 user nova-compute[73627]: INFO os_vif [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a')
Aug 26 16:32:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] No VIF found with MAC fa:16:3e:4a:53:d2, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-f5cd3fa6-8947-4978-80f9-662536818845 req-254a4df2-b67e-4d20-9bb1-cc02c0b76598 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f5cd3fa6-8947-4978-80f9-662536818845 req-254a4df2-b67e-4d20-9bb1-cc02c0b76598 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f5cd3fa6-8947-4978-80f9-662536818845 req-254a4df2-b67e-4d20-9bb1-cc02c0b76598 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f5cd3fa6-8947-4978-80f9-662536818845 req-254a4df2-b67e-4d20-9bb1-cc02c0b76598 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-f5cd3fa6-8947-4978-80f9-662536818845 req-254a4df2-b67e-4d20-9bb1-cc02c0b76598 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:09 user nova-compute[73627]: WARNING nova.compute.manager [req-f5cd3fa6-8947-4978-80f9-662536818845 req-254a4df2-b67e-4d20-9bb1-cc02c0b76598 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received unexpected event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with vm_state active and task_state resize_finish.
Aug 26 16:32:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067531.4511204, 19c82f60-3294-4a09-96a3-b03a1673149c => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:32:11 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] VM Resumed (Lifecycle Event)
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:11 user nova-compute[73627]: WARNING nova.compute.manager [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received unexpected event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with vm_state active and task_state resize_finish.
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Received event network-changed-85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Refreshing instance network info cache due to event network-changed-85e1be10-0bbc-46bd-87a7-7405dc3eed5c. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] Acquiring lock "refresh_cache-f27b7e07-8da2-4562-8ee4-5cec29543a01" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] Acquired lock "refresh_cache-f27b7e07-8da2-4562-8ee4-5cec29543a01" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.network.neutron [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Refreshing network info cache for port 85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:32:11 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:32:11 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=7198MB free_disk=25.228622436523438GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:11 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance running successfully.
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Failed to set time: agent not configured {{(pid=73627) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6b162953-3e70-402b-8a57-01f64bd15ce8 tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] finish_migration finished successfully. {{(pid=73627) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:32:11 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067531.4522984, 19c82f60-3294-4a09-96a3-b03a1673149c => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:32:11 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] VM Started (Lifecycle Event)
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Applying migration context for instance 19c82f60-3294-4a09-96a3-b03a1673149c as it has an incoming, in-progress migration 5b23a0b4-13c9-4c33-b0e9-6ab6fc0dffb7. Migration status is post-migrating {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 16:32:11 user nova-compute[73627]: INFO nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating resource usage from migration 5b23a0b4-13c9-4c33-b0e9-6ab6fc0dffb7
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:32:11 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 16:32:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a20c0a68-9781-4d6c-8f55-6952f1758f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c437818f-4799-4ad9-8463-f798c768cae9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f27b7e07-8da2-4562-8ee4-5cec29543a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Migration 5b23a0b4-13c9-4c33-b0e9-6ab6fc0dffb7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19c82f60-3294-4a09-96a3-b03a1673149c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance daca1645-10d4-45e7-874a-b2972a494e6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Updated VIF entry in instance network info cache for port 85e1be10-0bbc-46bd-87a7-7405dc3eed5c. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Updating instance_info_cache with network_info: [{"id": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "address": "fa:16:3e:e2:ba:32", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1be10-0b", "ovs_interfaceid": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.700s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5fdcf323-1b5c-43f1-9eec-3136d3824144 req-b714bbc0-047c-4378-8a21-f5201bb00916 service nova] Releasing lock "refresh_cache-f27b7e07-8da2-4562-8ee4-5cec29543a01" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:32:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:32:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:32:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:32:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:15 user nova-compute[73627]: DEBUG nova.objects.instance [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'flavor' on Instance uuid f27b7e07-8da2-4562-8ee4-5cec29543a01 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:16 user nova-compute[73627]: INFO nova.compute.manager [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Attaching volume 2441b0c0-f55b-478d-af0a-5b8d851a974f to /dev/vdb
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG os_brick.utils [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef6b2d2-fefe-4554-8519-7cea75f4d0b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e557b0-5271-4a22-8de6-987c308f7385]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3878066-7a7d-41f8-9ba9-ae1111662d30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dedb69-a279-4d6b-85dc-d2ff13241ea4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:32:16 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[26aec790-1efd-4f60-bef5-659c043a92b1]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG os_brick.utils [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Updating existing volume attachment record: 78468c64-dcd5-4b26-a204-bad442962411 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updating instance_info_cache with network_info: [{"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:32:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:32:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRiukDHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:32:28 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:32:28 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:32:28 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a582052f-96c7-4725-aec8-c6f79fd2f88b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:32:28 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3073ce7f-3633-4d27-ab10-85570ea53973]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f] added
Aug 26 16:32:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8488b00-bf57-48e9-9d1f-5dcae67a6593]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24bf7aa-9ab5-4de8-bb84-e1d1b943f3f0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRiukDHo {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRiukDHo" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[945450bb-3bd9-4e73-9337-05cc438bd26c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yRiukDHo'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a6b7eb-7821-42ca-9657-30889a78220d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b76dff-a2cc-4666-b107-86b2c9cf80f9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88dcf05-55cf-4ac3-8b5b-bcc682d531bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f, portal: 172.16.0.220,3260]
Aug 26 16:32:28 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f, portal: 172.16.0.220,3260] successful.
Aug 26 16:32:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa8a130-43ec-42ca-a50c-42e8810e8e2c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[41700ac5-1074-4c63-a836-cba145349fec]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f (non-flash)
Aug 26 16:32:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:28 user nova-compute[73627]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f (non-flash)
Aug 26 16:32:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88982a9-a6ba-426a-b4c9-0de539949650]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:32:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRiukDHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:32:29 user nova-compute[73627]: INFO nova.compute.claims [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Claim successful on node user
Aug 26 16:32:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23230616139323332', 'path': '/dev/sde'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230616139323332', 'path': '/dev/sde'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.objects.instance [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'flavor' on Instance uuid f27b7e07-8da2-4562-8ee4-5cec29543a01 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:32:29 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:32:29 user nova-compute[73627]:   <source dev="/dev/sde"/>
Aug 26 16:32:29 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:32:29 user nova-compute[73627]:   <serial>2441b0c0-f55b-478d-af0a-5b8d851a974f</serial>
Aug 26 16:32:29 user nova-compute[73627]: </disk>
Aug 26 16:32:29 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:32:29 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:32:29 user nova-compute[73627]: DEBUG nova.policy [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbd015cd3d2c4518817f1e78f70afc8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae57d24e815640678acc75e60a1d5412', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:32:30 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Creating image(s)
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "/opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "/opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "/opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No VIF found with MAC fa:16:3e:e2:ba:32, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.193s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-645528f0-24d6-461f-ac0a-1cb7be06fb9c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.263s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk 1073741824" returned: 0 in 0.053s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Checking if we can resize image /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Successfully created port: 60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Cannot resize image /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Ensure instance console log exists: /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:31 user nova-compute[73627]: INFO nova.compute.manager [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Detaching volume 2441b0c0-f55b-478d-af0a-5b8d851a974f
Aug 26 16:32:31 user nova-compute[73627]: INFO nova.virt.block_device [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Attempting to driver detach volume 2441b0c0-f55b-478d-af0a-5b8d851a974f from mountpoint /dev/vdb
Aug 26 16:32:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Attempting to detach device vdb from instance f27b7e07-8da2-4562-8ee4-5cec29543a01 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:32:31 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:32:31 user nova-compute[73627]:   <source dev="/dev/sde"/>
Aug 26 16:32:31 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:32:31 user nova-compute[73627]:   <serial>2441b0c0-f55b-478d-af0a-5b8d851a974f</serial>
Aug 26 16:32:31 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:32:31 user nova-compute[73627]: </disk>
Aug 26 16:32:31 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:32:31 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully detached device vdb from instance f27b7e07-8da2-4562-8ee4-5cec29543a01 from the persistent domain config.
Aug 26 16:32:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f27b7e07-8da2-4562-8ee4-5cec29543a01 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:32:31 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:32:31 user nova-compute[73627]:   <source dev="/dev/sde"/>
Aug 26 16:32:31 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:32:31 user nova-compute[73627]:   <serial>2441b0c0-f55b-478d-af0a-5b8d851a974f</serial>
Aug 26 16:32:31 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:32:31 user nova-compute[73627]: </disk>
Aug 26 16:32:31 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Successfully updated port: 60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "refresh_cache-914c5004-52af-4826-914d-ca3d215cf040" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquired lock "refresh_cache-914c5004-52af-4826-914d-ca3d215cf040" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-f686cd1e-fad3-483c-8798-eca9087dc623 req-54f7f125-1124-4d90-91f5-4f0d3343136c service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Received event network-changed-60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-f686cd1e-fad3-483c-8798-eca9087dc623 req-54f7f125-1124-4d90-91f5-4f0d3343136c service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Refreshing instance network info cache due to event network-changed-60dd7bfe-2839-4ce9-ba5c-df63337f418b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f686cd1e-fad3-483c-8798-eca9087dc623 req-54f7f125-1124-4d90-91f5-4f0d3343136c service nova] Acquiring lock "refresh_cache-914c5004-52af-4826-914d-ca3d215cf040" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:32:31 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Updating instance_info_cache with network_info: [{"id": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "address": "fa:16:3e:14:2f:bb", "network": {"id": "6c49bdb2-f5c9-4902-9d6e-9bcb5860a270", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1479283516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae57d24e815640678acc75e60a1d5412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7bfe-28", "ovs_interfaceid": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Releasing lock "refresh_cache-914c5004-52af-4826-914d-ca3d215cf040" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Instance network_info: |[{"id": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "address": "fa:16:3e:14:2f:bb", "network": {"id": "6c49bdb2-f5c9-4902-9d6e-9bcb5860a270", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1479283516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae57d24e815640678acc75e60a1d5412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7bfe-28", "ovs_interfaceid": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f686cd1e-fad3-483c-8798-eca9087dc623 req-54f7f125-1124-4d90-91f5-4f0d3343136c service nova] Acquired lock "refresh_cache-914c5004-52af-4826-914d-ca3d215cf040" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-f686cd1e-fad3-483c-8798-eca9087dc623 req-54f7f125-1124-4d90-91f5-4f0d3343136c service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Refreshing network info cache for port 60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Start _get_guest_xml network_info=[{"id": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "address": "fa:16:3e:14:2f:bb", "network": {"id": "6c49bdb2-f5c9-4902-9d6e-9bcb5860a270", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1479283516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae57d24e815640678acc75e60a1d5412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7bfe-28", "ovs_interfaceid": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:32:32 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:32:32 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067552.2745392, f27b7e07-8da2-4562-8ee4-5cec29543a01 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f27b7e07-8da2-4562-8ee4-5cec29543a01 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:32:32 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully detached device vdb from instance f27b7e07-8da2-4562-8ee4-5cec29543a01 from the live domain config.
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-378428966',display_name='tempest-TestServerVolumeAttachmentScenario-server-378428966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-378428966',id=28,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWKxC4V7JWxQf9iBL2XdLfz4SGoiXmxFQmGgXsCZsIweqWEaHR37Uvd3m37Y0HczC5CQ/WLPk3vOXywdrln+yZ1DzWPbLFGOFahVgEMXG+ImUZZUUa3yln11fkza9iTvQ==',key_name='tempest-keypair-798834650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae57d24e815640678acc75e60a1d5412',ramdisk_id='',reservation_id='r-0006gh3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1145809252',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1145809252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:32:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbd015cd3d2c4518817f1e78f70afc8c',uuid=914c5004-52af-4826-914d-ca3d215cf040,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "address": "fa:16:3e:14:2f:bb", "network": {"id": "6c49bdb2-f5c9-4902-9d6e-9bcb5860a270", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1479283516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae57d24e815640678acc75e60a1d5412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7bfe-28", "ovs_interfaceid": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Converting VIF {"id": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "address": "fa:16:3e:14:2f:bb", "network": {"id": "6c49bdb2-f5c9-4902-9d6e-9bcb5860a270", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1479283516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae57d24e815640678acc75e60a1d5412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7bfe-28", "ovs_interfaceid": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=60dd7bfe-2839-4ce9-ba5c-df63337f418b,network=Network(6c49bdb2-f5c9-4902-9d6e-9bcb5860a270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7bfe-28') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lazy-loading 'pci_devices' on Instance uuid 914c5004-52af-4826-914d-ca3d215cf040 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRiukDHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:32:32 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:32:32 user nova-compute[73627]:   <uuid>914c5004-52af-4826-914d-ca3d215cf040</uuid>
Aug 26 16:32:32 user nova-compute[73627]:   <name>instance-0000001c</name>
Aug 26 16:32:32 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:32:32 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:32:32 user nova-compute[73627]:   <metadata>
Aug 26 16:32:32 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:32:32 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:32:32 user nova-compute[73627]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-378428966</nova:name>
Aug 26 16:32:32 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:32:32</nova:creationTime>
Aug 26 16:32:32 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:32:32 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:32:32 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:32:32 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:32:32 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:32:32 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:32:32 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:32:32 user nova-compute[73627]:       <nova:owner>
Aug 26 16:32:32 user nova-compute[73627]:         <nova:user uuid="dbd015cd3d2c4518817f1e78f70afc8c">tempest-TestServerVolumeAttachmentScenario-1145809252-project-member</nova:user>
Aug 26 16:32:32 user nova-compute[73627]:         <nova:project uuid="ae57d24e815640678acc75e60a1d5412">tempest-TestServerVolumeAttachmentScenario-1145809252</nova:project>
Aug 26 16:32:32 user nova-compute[73627]:       </nova:owner>
Aug 26 16:32:32 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:32:32 user nova-compute[73627]:       <nova:ports>
Aug 26 16:32:32 user nova-compute[73627]:         <nova:port uuid="60dd7bfe-2839-4ce9-ba5c-df63337f418b">
Aug 26 16:32:32 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 16:32:32 user nova-compute[73627]:         </nova:port>
Aug 26 16:32:32 user nova-compute[73627]:       </nova:ports>
Aug 26 16:32:32 user nova-compute[73627]:     </nova:instance>
Aug 26 16:32:32 user nova-compute[73627]:   </metadata>
Aug 26 16:32:32 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:32:32 user nova-compute[73627]:     <system>
Aug 26 16:32:32 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:32:32 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:32:32 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:32:32 user nova-compute[73627]:       <entry name="serial">914c5004-52af-4826-914d-ca3d215cf040</entry>
Aug 26 16:32:32 user nova-compute[73627]:       <entry name="uuid">914c5004-52af-4826-914d-ca3d215cf040</entry>
Aug 26 16:32:32 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:32:32 user nova-compute[73627]:     </system>
Aug 26 16:32:32 user nova-compute[73627]:   </sysinfo>
Aug 26 16:32:32 user nova-compute[73627]:   <os>
Aug 26 16:32:32 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:32:32 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:32:32 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:32:32 user nova-compute[73627]:   </os>
Aug 26 16:32:32 user nova-compute[73627]:   <features>
Aug 26 16:32:32 user nova-compute[73627]:     <acpi/>
Aug 26 16:32:32 user nova-compute[73627]:     <apic/>
Aug 26 16:32:32 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:32:32 user nova-compute[73627]:   </features>
Aug 26 16:32:32 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:32:32 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:32:32 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:32:32 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:32:32 user nova-compute[73627]:   </clock>
Aug 26 16:32:32 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:32:32 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:32:32 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:32:32 user nova-compute[73627]:   </cpu>
Aug 26 16:32:32 user nova-compute[73627]:   <devices>
Aug 26 16:32:32 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:32:32 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:32:32 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk"/>
Aug 26 16:32:32 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:32:32 user nova-compute[73627]:     </disk>
Aug 26 16:32:32 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:32:32 user nova-compute[73627]:       <mac address="fa:16:3e:14:2f:bb"/>
Aug 26 16:32:32 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:32:32 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:32:32 user nova-compute[73627]:       <target dev="tap60dd7bfe-28"/>
Aug 26 16:32:32 user nova-compute[73627]:     </interface>
Aug 26 16:32:32 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:32:32 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/console.log" append="off"/>
Aug 26 16:32:32 user nova-compute[73627]:     </serial>
Aug 26 16:32:32 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:32:32 user nova-compute[73627]:     <video>
Aug 26 16:32:32 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:32:32 user nova-compute[73627]:     </video>
Aug 26 16:32:32 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:32:32 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:32:32 user nova-compute[73627]:     </rng>
Aug 26 16:32:32 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:32:32 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:32:32 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:32:32 user nova-compute[73627]:     </memballoon>
Aug 26 16:32:32 user nova-compute[73627]:   </devices>
Aug 26 16:32:32 user nova-compute[73627]: </domain>
Aug 26 16:32:32 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-378428966',display_name='tempest-TestServerVolumeAttachmentScenario-server-378428966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-378428966',id=28,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWKxC4V7JWxQf9iBL2XdLfz4SGoiXmxFQmGgXsCZsIweqWEaHR37Uvd3m37Y0HczC5CQ/WLPk3vOXywdrln+yZ1DzWPbLFGOFahVgEMXG+ImUZZUUa3yln11fkza9iTvQ==',key_name='tempest-keypair-798834650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae57d24e815640678acc75e60a1d5412',ramdisk_id='',reservation_id='r-0006gh3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1145809252',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1145809252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:32:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbd015cd3d2c4518817f1e78f70afc8c',uuid=914c5004-52af-4826-914d-ca3d215cf040,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "address": "fa:16:3e:14:2f:bb", "network": {"id": "6c49bdb2-f5c9-4902-9d6e-9bcb5860a270", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1479283516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae57d24e815640678acc75e60a1d5412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7bfe-28", "ovs_interfaceid": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Converting VIF {"id": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "address": "fa:16:3e:14:2f:bb", "network": {"id": "6c49bdb2-f5c9-4902-9d6e-9bcb5860a270", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1479283516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae57d24e815640678acc75e60a1d5412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7bfe-28", "ovs_interfaceid": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=60dd7bfe-2839-4ce9-ba5c-df63337f418b,network=Network(6c49bdb2-f5c9-4902-9d6e-9bcb5860a270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7bfe-28') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_vif [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=60dd7bfe-2839-4ce9-ba5c-df63337f418b,network=Network(6c49bdb2-f5c9-4902-9d6e-9bcb5860a270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7bfe-28') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60dd7bfe-28, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60dd7bfe-28, col_values=(('external_ids', {'iface-id': '60dd7bfe-2839-4ce9-ba5c-df63337f418b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:2f:bb', 'vm-uuid': '914c5004-52af-4826-914d-ca3d215cf040'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecfc730-4e53-4b8f-b76a-3e9c833a003c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:32 user nova-compute[73627]: INFO os_vif [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=60dd7bfe-2839-4ce9-ba5c-df63337f418b,network=Network(6c49bdb2-f5c9-4902-9d6e-9bcb5860a270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7bfe-28')
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d09222-3ee0-4e87-808b-c9f8abefd596]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:32 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:32 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:32 user nova-compute[73627]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f (non-flash)
Aug 26 16:32:32 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:32 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:32 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:32 user nova-compute[73627]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f (non-flash)
Aug 26 16:32:32 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d01481f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f'): ({'sde'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Removing single pathed devices sde {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] No VIF found with MAC fa:16:3e:14:2f:bb, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73690cf-8df9-480c-aeff-0f93a1b380d7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[837e2ba5-e82e-4482-b078-664e474085b4]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Flushing IO for device /dev/sde {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[183b5c47-5d68-4b63-bab3-ad45ccb8f3a8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[687b8638-0fc0-43ee-8d6c-ed1c23e9f24a]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e60ca-1c9c-4516-b03f-89fc6bf5a003]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:32:32 user nova-compute[73627]: INFO nova.compute.claims [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Claim successful on node user
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccd6d84-7a6e-4f64-a819-9c9c3665879d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f, portal: 172.16.0.220,3260]
Aug 26 16:32:32 user nova-compute[73627]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f, portal: 172.16.0.220,3260] successful.
Aug 26 16:32:32 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2441b0c0-f55b-478d-af0a-5b8d851a974f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a1ed72-79a0-4972-baa5-1f3e6ea81db3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] <== disconnect_volume: return (343ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-f686cd1e-fad3-483c-8798-eca9087dc623 req-54f7f125-1124-4d90-91f5-4f0d3343136c service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Updated VIF entry in instance network info cache for port 60dd7bfe-2839-4ce9-ba5c-df63337f418b. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-f686cd1e-fad3-483c-8798-eca9087dc623 req-54f7f125-1124-4d90-91f5-4f0d3343136c service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Updating instance_info_cache with network_info: [{"id": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "address": "fa:16:3e:14:2f:bb", "network": {"id": "6c49bdb2-f5c9-4902-9d6e-9bcb5860a270", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1479283516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae57d24e815640678acc75e60a1d5412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7bfe-28", "ovs_interfaceid": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:32:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f686cd1e-fad3-483c-8798-eca9087dc623 req-54f7f125-1124-4d90-91f5-4f0d3343136c service nova] Releasing lock "refresh_cache-914c5004-52af-4826-914d-ca3d215cf040" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.655s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:32:33 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:32:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG nova.policy [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8945b1b1110e44568e0de86204d65e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8aed25a3184cf884a5774515d6d202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:32:33 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Creating image(s)
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "/opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "/opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'flavor' on Instance uuid f27b7e07-8da2-4562-8ee4-5cec29543a01 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b894d299-c6b5-4fd6-a52d-603466f8df0a tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.209s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.194s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk 1073741824" returned: 0 in 0.071s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.199s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-e3a78bf9-6dcb-477b-aca6-55842b40efbf req-5ee6eba7-eb44-4af2-bf4a-0688dbf5a876 service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Received event network-vif-plugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e3a78bf9-6dcb-477b-aca6-55842b40efbf req-5ee6eba7-eb44-4af2-bf4a-0688dbf5a876 service nova] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e3a78bf9-6dcb-477b-aca6-55842b40efbf req-5ee6eba7-eb44-4af2-bf4a-0688dbf5a876 service nova] Lock "914c5004-52af-4826-914d-ca3d215cf040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e3a78bf9-6dcb-477b-aca6-55842b40efbf req-5ee6eba7-eb44-4af2-bf4a-0688dbf5a876 service nova] Lock "914c5004-52af-4826-914d-ca3d215cf040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-e3a78bf9-6dcb-477b-aca6-55842b40efbf req-5ee6eba7-eb44-4af2-bf4a-0688dbf5a876 service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] No waiting events found dispatching network-vif-plugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:34 user nova-compute[73627]: WARNING nova.compute.manager [req-e3a78bf9-6dcb-477b-aca6-55842b40efbf req-5ee6eba7-eb44-4af2-bf4a-0688dbf5a876 service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Received unexpected event network-vif-plugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b for instance with vm_state building and task_state spawning.
Aug 26 16:32:34 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Successfully created port: e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Cannot resize image /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Ensure instance console log exists: /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:34 user nova-compute[73627]: INFO nova.compute.manager [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Detaching volume 6cb32b9d-e58b-4ea0-a116-be9b8797f5d5
Aug 26 16:32:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:34 user nova-compute[73627]: INFO nova.virt.block_device [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Attempting to driver detach volume 6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 from mountpoint /dev/vdb
Aug 26 16:32:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Attempting to detach device vdb from instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:32:34 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:32:34 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:32:34 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:32:34 user nova-compute[73627]:   <serial>6cb32b9d-e58b-4ea0-a116-be9b8797f5d5</serial>
Aug 26 16:32:34 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 16:32:34 user nova-compute[73627]: </disk>
Aug 26 16:32:34 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:32:34 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully detached device vdb from instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 from the persistent domain config.
Aug 26 16:32:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:32:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:32:34 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:32:34 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:32:34 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:32:34 user nova-compute[73627]:   <serial>6cb32b9d-e58b-4ea0-a116-be9b8797f5d5</serial>
Aug 26 16:32:34 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 16:32:34 user nova-compute[73627]: </disk>
Aug 26 16:32:34 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067555.1726205, 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:32:35 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully detached device vdb from instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 from the live domain config.
Aug 26 16:32:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbWXUMcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:32:35 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8f8135-f027-42ff-a85e-f1e42e65b0ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e972c8-dbac-423e-b395-6ec5bd335c1d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:35 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:35 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:35 user nova-compute[73627]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 (non-flash)
Aug 26 16:32:35 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e835a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Successfully updated port: e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "refresh_cache-b5277d78-3a96-4d79-8825-26d042254c12" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquired lock "refresh_cache-b5277d78-3a96-4d79-8825-26d042254c12" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4d0071-e197-4039-95ed-200b402bd62f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33c8a55-bf4a-49fd-8717-49827c440e42]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a526990d-1846-4b32-920c-ae1f7a017d79]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91b03e0-53ce-47af-b17e-2bdf5c9404f0]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e443dedb-9914-4d45-af10-4e8da54c681c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ef0f22-ca6f-491d-ac5d-3ab2cb4c82ce]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260]
Aug 26 16:32:35 user nova-compute[73627]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5, portal: 172.16.0.220,3260] successful.
Aug 26 16:32:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cb32b9d-e58b-4ea0-a116-be9b8797f5d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd693d2-393b-4468-b946-d3b9111f771c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] <== disconnect_volume: return (328ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Updating instance_info_cache with network_info: [{"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Releasing lock "refresh_cache-b5277d78-3a96-4d79-8825-26d042254c12" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Instance network_info: |[{"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Start _get_guest_xml network_info=[{"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:32:36 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:32:36 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1120972842',display_name='tempest-tempest.common.compute-instance-1120972842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1120972842',id=29,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGEVaZilfejgzOVBO/Dl5oWhwyQx7yT0CQZLwHfV5uQSNiyESnSSBwifVOuHAIiHVCjFzc8FACGrVIdJFbzB7rWnkykjmcwfVvI05Tl83CL/v/O1MgJawrdf1YL0vZThg==',key_name='tempest-keypair-645263688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-lbff6ir2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=b5277d78-3a96-4d79-8825-26d042254c12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.objects.instance [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'pci_devices' on Instance uuid b5277d78-3a96-4d79-8825-26d042254c12 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:32:36 user nova-compute[73627]:   <uuid>b5277d78-3a96-4d79-8825-26d042254c12</uuid>
Aug 26 16:32:36 user nova-compute[73627]:   <name>instance-0000001d</name>
Aug 26 16:32:36 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:32:36 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:32:36 user nova-compute[73627]:   <metadata>
Aug 26 16:32:36 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:32:36 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:32:36 user nova-compute[73627]:       <nova:name>tempest-tempest.common.compute-instance-1120972842</nova:name>
Aug 26 16:32:36 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:32:36</nova:creationTime>
Aug 26 16:32:36 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:32:36 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:32:36 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:32:36 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:32:36 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:32:36 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:32:36 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:32:36 user nova-compute[73627]:       <nova:owner>
Aug 26 16:32:36 user nova-compute[73627]:         <nova:user uuid="8945b1b1110e44568e0de86204d65e34">tempest-ServerActionsTestOtherA-1664197223-project-member</nova:user>
Aug 26 16:32:36 user nova-compute[73627]:         <nova:project uuid="3f8aed25a3184cf884a5774515d6d202">tempest-ServerActionsTestOtherA-1664197223</nova:project>
Aug 26 16:32:36 user nova-compute[73627]:       </nova:owner>
Aug 26 16:32:36 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:32:36 user nova-compute[73627]:       <nova:ports>
Aug 26 16:32:36 user nova-compute[73627]:         <nova:port uuid="e193c76c-8dac-420e-9749-9c42f62ad3cf">
Aug 26 16:32:36 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 16:32:36 user nova-compute[73627]:         </nova:port>
Aug 26 16:32:36 user nova-compute[73627]:       </nova:ports>
Aug 26 16:32:36 user nova-compute[73627]:     </nova:instance>
Aug 26 16:32:36 user nova-compute[73627]:   </metadata>
Aug 26 16:32:36 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:32:36 user nova-compute[73627]:     <system>
Aug 26 16:32:36 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:32:36 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:32:36 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:32:36 user nova-compute[73627]:       <entry name="serial">b5277d78-3a96-4d79-8825-26d042254c12</entry>
Aug 26 16:32:36 user nova-compute[73627]:       <entry name="uuid">b5277d78-3a96-4d79-8825-26d042254c12</entry>
Aug 26 16:32:36 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:32:36 user nova-compute[73627]:     </system>
Aug 26 16:32:36 user nova-compute[73627]:   </sysinfo>
Aug 26 16:32:36 user nova-compute[73627]:   <os>
Aug 26 16:32:36 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:32:36 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:32:36 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:32:36 user nova-compute[73627]:   </os>
Aug 26 16:32:36 user nova-compute[73627]:   <features>
Aug 26 16:32:36 user nova-compute[73627]:     <acpi/>
Aug 26 16:32:36 user nova-compute[73627]:     <apic/>
Aug 26 16:32:36 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:32:36 user nova-compute[73627]:   </features>
Aug 26 16:32:36 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:32:36 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:32:36 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:32:36 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:32:36 user nova-compute[73627]:   </clock>
Aug 26 16:32:36 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:32:36 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:32:36 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:32:36 user nova-compute[73627]:   </cpu>
Aug 26 16:32:36 user nova-compute[73627]:   <devices>
Aug 26 16:32:36 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:32:36 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:32:36 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk"/>
Aug 26 16:32:36 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:32:36 user nova-compute[73627]:     </disk>
Aug 26 16:32:36 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:32:36 user nova-compute[73627]:       <mac address="fa:16:3e:cd:6e:eb"/>
Aug 26 16:32:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:32:36 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:32:36 user nova-compute[73627]:       <target dev="tape193c76c-8d"/>
Aug 26 16:32:36 user nova-compute[73627]:     </interface>
Aug 26 16:32:36 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:32:36 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/console.log" append="off"/>
Aug 26 16:32:36 user nova-compute[73627]:     </serial>
Aug 26 16:32:36 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:32:36 user nova-compute[73627]:     <video>
Aug 26 16:32:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:32:36 user nova-compute[73627]:     </video>
Aug 26 16:32:36 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:32:36 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:32:36 user nova-compute[73627]:     </rng>
Aug 26 16:32:36 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:32:36 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:32:36 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:32:36 user nova-compute[73627]:     </memballoon>
Aug 26 16:32:36 user nova-compute[73627]:   </devices>
Aug 26 16:32:36 user nova-compute[73627]: </domain>
Aug 26 16:32:36 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1120972842',display_name='tempest-tempest.common.compute-instance-1120972842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1120972842',id=29,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGEVaZilfejgzOVBO/Dl5oWhwyQx7yT0CQZLwHfV5uQSNiyESnSSBwifVOuHAIiHVCjFzc8FACGrVIdJFbzB7rWnkykjmcwfVvI05Tl83CL/v/O1MgJawrdf1YL0vZThg==',key_name='tempest-keypair-645263688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-lbff6ir2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=b5277d78-3a96-4d79-8825-26d042254c12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG os_vif [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape193c76c-8d, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape193c76c-8d, col_values=(('external_ids', {'iface-id': 'e193c76c-8dac-420e-9749-9c42f62ad3cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:6e:eb', 'vm-uuid': 'b5277d78-3a96-4d79-8825-26d042254c12'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:36 user nova-compute[73627]: INFO os_vif [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d')
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067556.1719275, 914c5004-52af-4826-914d-ca3d215cf040 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:32:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 914c5004-52af-4826-914d-ca3d215cf040] VM Resumed (Lifecycle Event)
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:32:36 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Instance spawned successfully.
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No VIF found with MAC fa:16:3e:cd:6e:eb, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 914c5004-52af-4826-914d-ca3d215cf040] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067556.1733918, 914c5004-52af-4826-914d-ca3d215cf040 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:32:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 914c5004-52af-4826-914d-ca3d215cf040] VM Started (Lifecycle Event)
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:32:36 user nova-compute[73627]: INFO nova.compute.manager [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 914c5004-52af-4826-914d-ca3d215cf040] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.objects.instance [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Received event network-vif-plugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] Lock "914c5004-52af-4826-914d-ca3d215cf040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] Lock "914c5004-52af-4826-914d-ca3d215cf040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] No waiting events found dispatching network-vif-plugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:36 user nova-compute[73627]: WARNING nova.compute.manager [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Received unexpected event network-vif-plugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b for instance with vm_state building and task_state spawning.
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-changed-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Refreshing instance network info cache due to event network-changed-e193c76c-8dac-420e-9749-9c42f62ad3cf. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] Acquiring lock "refresh_cache-b5277d78-3a96-4d79-8825-26d042254c12" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] Acquired lock "refresh_cache-b5277d78-3a96-4d79-8825-26d042254c12" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.network.neutron [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Refreshing network info cache for port e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1b3f79a1-49d5-4391-b01a-729cb7f7ffbd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.850s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:36 user nova-compute[73627]: INFO nova.compute.manager [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Took 7.34 seconds to build instance.
Aug 26 16:32:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a70d32e-9072-4333-a038-4afe5f2c52cd tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.461s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.network.neutron [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Updated VIF entry in instance network info cache for port e193c76c-8dac-420e-9749-9c42f62ad3cf. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.network.neutron [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Updating instance_info_cache with network_info: [{"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ec4d0e4d-aa92-4a83-97ef-c9e0b5fa210f req-83239496-dbc3-4a44-af08-a474cf960edb service nova] Releasing lock "refresh_cache-b5277d78-3a96-4d79-8825-26d042254c12" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7f36643d-8a83-4fa3-8925-45a76978842a tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7f36643d-8a83-4fa3-8925-45a76978842a tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7f36643d-8a83-4fa3-8925-45a76978842a tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7f36643d-8a83-4fa3-8925-45a76978842a tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73627) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 16:32:36 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7f36643d-8a83-4fa3-8925-45a76978842a tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG nova.compute.manager [req-4df8e2b4-78ee-4a5e-a47f-e89d39c8286b req-bc11f12a-daf5-4e58-b446-fdbcd5eff8d1 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4df8e2b4-78ee-4a5e-a47f-e89d39c8286b req-bc11f12a-daf5-4e58-b446-fdbcd5eff8d1 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4df8e2b4-78ee-4a5e-a47f-e89d39c8286b req-bc11f12a-daf5-4e58-b446-fdbcd5eff8d1 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4df8e2b4-78ee-4a5e-a47f-e89d39c8286b req-bc11f12a-daf5-4e58-b446-fdbcd5eff8d1 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG nova.compute.manager [req-4df8e2b4-78ee-4a5e-a47f-e89d39c8286b req-bc11f12a-daf5-4e58-b446-fdbcd5eff8d1 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:37 user nova-compute[73627]: WARNING nova.compute.manager [req-4df8e2b4-78ee-4a5e-a47f-e89d39c8286b req-bc11f12a-daf5-4e58-b446-fdbcd5eff8d1 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state active and task_state powering-off.
Aug 26 16:32:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:37 user nova-compute[73627]: INFO nova.compute.manager [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Terminating instance
Aug 26 16:32:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:38 user nova-compute[73627]: INFO nova.compute.manager [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Unshelving
Aug 26 16:32:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-e50f643e-3814-4d13-b2a3-93ef4bb17acb req-0528987a-23d8-4033-8e80-8f1fca8df45b service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e50f643e-3814-4d13-b2a3-93ef4bb17acb req-0528987a-23d8-4033-8e80-8f1fca8df45b service nova] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e50f643e-3814-4d13-b2a3-93ef4bb17acb req-0528987a-23d8-4033-8e80-8f1fca8df45b service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e50f643e-3814-4d13-b2a3-93ef4bb17acb req-0528987a-23d8-4033-8e80-8f1fca8df45b service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-e50f643e-3814-4d13-b2a3-93ef4bb17acb req-0528987a-23d8-4033-8e80-8f1fca8df45b service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] No waiting events found dispatching network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:38 user nova-compute[73627]: WARNING nova.compute.manager [req-e50f643e-3814-4d13-b2a3-93ef4bb17acb req-0528987a-23d8-4033-8e80-8f1fca8df45b service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received unexpected event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf for instance with vm_state building and task_state spawning.
Aug 26 16:32:38 user nova-compute[73627]: INFO nova.virt.block_device [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Booting with volume aa965f18-ad75-4899-bbf7-c4a26cd3fa28 at /dev/vdc
Aug 26 16:32:38 user nova-compute[73627]: DEBUG os_brick.utils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1616c2ce-021a-4d6b-b0fc-4e79a6a818d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c667bb-2a87-407a-a326-47034832bf30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aff327-199e-4caf-9110-0502777176e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a387145-54f9-4ee2-ab71-b64cbda3f7c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:32:38 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[816b53af-3928-47fe-8081-7c20234d21d1]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG os_brick.utils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updating existing volume attachment record: 1a266960-fb16-4ec8-9d45-9be4a70f4dc0 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:32:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance destroyed successfully.
Aug 26 16:32:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7f36643d-8a83-4fa3-8925-45a76978842a tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Instance destroyed successfully.
Aug 26 16:32:38 user nova-compute[73627]: DEBUG nova.objects.instance [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lazy-loading 'resources' on Instance uuid c437818f-4799-4ad9-8463-f798c768cae9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-473756470',display_name='tempest-TestVolumeSwap-server-473756470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-473756470',id=21,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6ogYs059BmYfaPDY/nm3JFFULOAbW8sqBs+XFUzElYr2bLklYtxdJr6Zj/r5TDimIpsLf+TcIq4FNT7sMB1JHTr3bu7oSpsem8G109oILgDzIPymoZHEgcC/s5SYY2iA==',key_name='tempest-keypair-1056555196',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:29:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8293bcf7a5574394925ca3cf956f0b77',ramdisk_id='',reservation_id='r-fpfnm8a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2084039538',owner_user_name='tempest-TestVolumeSwap-2084039538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a886201ea8f4f49a7ad9a4ce5d96e94',uuid=c437818f-4799-4ad9-8463-f798c768cae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "address": "fa:16:3e:c4:29:2c", "network": {"id": "332616a2-e157-4895-aae0-b62458e95855", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1228136515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8293bcf7a5574394925ca3cf956f0b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf080d0ea-ed", "ovs_interfaceid": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Converting VIF {"id": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "address": "fa:16:3e:c4:29:2c", "network": {"id": "332616a2-e157-4895-aae0-b62458e95855", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1228136515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8293bcf7a5574394925ca3cf956f0b77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf080d0ea-ed", "ovs_interfaceid": "f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:29:2c,bridge_name='br-int',has_traffic_filtering=True,id=f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76,network=Network(332616a2-e157-4895-aae0-b62458e95855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf080d0ea-ed') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG os_vif [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:29:2c,bridge_name='br-int',has_traffic_filtering=True,id=f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76,network=Network(332616a2-e157-4895-aae0-b62458e95855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf080d0ea-ed') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf080d0ea-ed, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:32:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:38 user nova-compute[73627]: INFO os_vif [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:29:2c,bridge_name='br-int',has_traffic_filtering=True,id=f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76,network=Network(332616a2-e157-4895-aae0-b62458e95855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf080d0ea-ed')
Aug 26 16:32:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Deleting instance files /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9_del
Aug 26 16:32:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Deletion of /opt/stack/data/nova/instances/c437818f-4799-4ad9-8463-f798c768cae9_del complete
Aug 26 16:32:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7f36643d-8a83-4fa3-8925-45a76978842a tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.962s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:39 user nova-compute[73627]: INFO nova.compute.manager [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: c437818f-4799-4ad9-8463-f798c768cae9] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:39 user nova-compute[73627]: WARNING nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state stopped and task_state None.
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Received event network-vif-unplugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Lock "c437818f-4799-4ad9-8463-f798c768cae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Lock "c437818f-4799-4ad9-8463-f798c768cae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] No waiting events found dispatching network-vif-unplugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Received event network-vif-unplugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Received event network-vif-plugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Acquiring lock "c437818f-4799-4ad9-8463-f798c768cae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Lock "c437818f-4799-4ad9-8463-f798c768cae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Lock "c437818f-4799-4ad9-8463-f798c768cae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] No waiting events found dispatching network-vif-plugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:39 user nova-compute[73627]: WARNING nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Received unexpected event network-vif-plugged-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 for instance with vm_state active and task_state deleting.
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:39 user nova-compute[73627]: WARNING nova.compute.manager [req-e799b817-7db4-46ca-824f-7673073d12ea req-a650b28b-cf8e-40a9-ae54-3adb04dfae7b service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state stopped and task_state None.
Aug 26 16:32:39 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:32:39 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Took 0.89 seconds to deallocate network for instance.
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-a8e08b9e-0ef5-4820-ae7f-48bd9b5c6aa6 req-2f4cc698-d09c-4b47-b355-0c95405899a4 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a8e08b9e-0ef5-4820-ae7f-48bd9b5c6aa6 req-2f4cc698-d09c-4b47-b355-0c95405899a4 service nova] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a8e08b9e-0ef5-4820-ae7f-48bd9b5c6aa6 req-2f4cc698-d09c-4b47-b355-0c95405899a4 service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a8e08b9e-0ef5-4820-ae7f-48bd9b5c6aa6 req-2f4cc698-d09c-4b47-b355-0c95405899a4 service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-a8e08b9e-0ef5-4820-ae7f-48bd9b5c6aa6 req-2f4cc698-d09c-4b47-b355-0c95405899a4 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] No waiting events found dispatching network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:40 user nova-compute[73627]: WARNING nova.compute.manager [req-a8e08b9e-0ef5-4820-ae7f-48bd9b5c6aa6 req-2f4cc698-d09c-4b47-b355-0c95405899a4 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received unexpected event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf for instance with vm_state building and task_state spawning.
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-a8e08b9e-0ef5-4820-ae7f-48bd9b5c6aa6 req-2f4cc698-d09c-4b47-b355-0c95405899a4 service nova] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Received event network-vif-deleted-f080d0ea-ed65-4e3b-a7ce-4ef3e2279f76 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.534s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:40 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Deleted allocations for instance c437818f-4799-4ad9-8463-f798c768cae9
Aug 26 16:32:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-94afa314-ee56-4b72-a704-54cc50fe6a56 tempest-TestVolumeSwap-2084039538 tempest-TestVolumeSwap-2084039538-project-member] Lock "c437818f-4799-4ad9-8463-f798c768cae9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.934s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067560.8022285, b5277d78-3a96-4d79-8825-26d042254c12 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:32:40 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] VM Resumed (Lifecycle Event)
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:32:40 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Instance spawned successfully.
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:32:40 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067560.8042696, b5277d78-3a96-4d79-8825-26d042254c12 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:32:40 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] VM Started (Lifecycle Event)
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:32:40 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:32:41 user nova-compute[73627]: INFO nova.compute.manager [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Took 7.48 seconds to spawn the instance on the hypervisor.
Aug 26 16:32:41 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:41 user nova-compute[73627]: INFO nova.compute.manager [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Took 8.54 seconds to build instance.
Aug 26 16:32:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22a1f28e-ede5-40ed-8e95-0c1cece64879 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.673s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:41 user nova-compute[73627]: WARNING nova.compute.manager [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state stopped and task_state None.
Aug 26 16:32:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:41 user nova-compute[73627]: WARNING nova.compute.manager [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state stopped and task_state None.
Aug 26 16:32:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:32:41 user nova-compute[73627]: WARNING nova.compute.manager [req-c81fca8b-d167-4207-ab4c-53003041b897 req-ebd7a238-5434-4894-bf68-b12f75e4e1a4 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state stopped and task_state None.
Aug 26 16:32:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:50 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'pci_requests' on Instance uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:50 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'numa_topology' on Instance uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:50 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:32:50 user nova-compute[73627]: INFO nova.compute.claims [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Claim successful on node user
Aug 26 16:32:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:50 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:32:50 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:32:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:51 user nova-compute[73627]: INFO nova.network.neutron [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updating port acc0dfcd-a792-461b-890b-47ad7a7ca1e4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 16:32:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:32:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquired lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:32:51 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:32:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-3ebcacbd-e656-4d7b-8536-4560cc1a5079 req-1f6a7c0c-bf12-4c82-bf04-cc108d19398d service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-changed-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:32:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-3ebcacbd-e656-4d7b-8536-4560cc1a5079 req-1f6a7c0c-bf12-4c82-bf04-cc108d19398d service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Refreshing instance network info cache due to event network-changed-acc0dfcd-a792-461b-890b-47ad7a7ca1e4. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:32:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3ebcacbd-e656-4d7b-8536-4560cc1a5079 req-1f6a7c0c-bf12-4c82-bf04-cc108d19398d service nova] Acquiring lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:32:52 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updating instance_info_cache with network_info: [{"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:32:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Releasing lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:32:52 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:32:52 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Creating image(s)
Aug 26 16:32:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "/opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "/opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:52 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'trusted_certs' on Instance uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3ebcacbd-e656-4d7b-8536-4560cc1a5079 req-1f6a7c0c-bf12-4c82-bf04-cc108d19398d service nova] Acquired lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:32:52 user nova-compute[73627]: DEBUG nova.network.neutron [req-3ebcacbd-e656-4d7b-8536-4560cc1a5079 req-1f6a7c0c-bf12-4c82-bf04-cc108d19398d service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Refreshing network info cache for port acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:32:52 user nova-compute[73627]: DEBUG nova.objects.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Object Instance<b1f798a4-a09c-4a10-ba68-650b7c757f7f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:32:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "41b5dc347b4d9362d0844944fe09edfb9c765171" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "41b5dc347b4d9362d0844944fe09edfb9c765171" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171.part --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171.part --force-share --output=json" returned: 0 in 0.202s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG nova.virt.images [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] c23f8623-a8c0-4eca-b2f3-d630d592ec98 was qcow2, converting to raw {{(pid=73627) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171.part /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171.converted {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG nova.network.neutron [req-3ebcacbd-e656-4d7b-8536-4560cc1a5079 req-1f6a7c0c-bf12-4c82-bf04-cc108d19398d service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updated VIF entry in instance network info cache for port acc0dfcd-a792-461b-890b-47ad7a7ca1e4. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG nova.network.neutron [req-3ebcacbd-e656-4d7b-8536-4560cc1a5079 req-1f6a7c0c-bf12-4c82-bf04-cc108d19398d service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updating instance_info_cache with network_info: [{"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:53 user nova-compute[73627]: INFO nova.compute.manager [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Unshelving
Aug 26 16:32:53 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067558.8017068, 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:32:53 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] VM Stopped (Lifecycle Event)
Aug 26 16:32:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3ebcacbd-e656-4d7b-8536-4560cc1a5079 req-1f6a7c0c-bf12-4c82-bf04-cc108d19398d service nova] Releasing lock "refresh_cache-b1f798a4-a09c-4a10-ba68-650b7c757f7f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067558.852367, c437818f-4799-4ad9-8463-f798c768cae9 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:32:53 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: c437818f-4799-4ad9-8463-f798c768cae9] VM Stopped (Lifecycle Event)
Aug 26 16:32:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-aeef9cc6-02e4-4faa-952a-7396b8bd051b None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-aeef9cc6-02e4-4faa-952a-7396b8bd051b None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-fc636066-caef-454b-b4e0-2810c5141106 None None] [instance: c437818f-4799-4ad9-8463-f798c768cae9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171.part /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171.converted" returned: 0 in 0.431s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171.converted --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:54 user nova-compute[73627]: INFO nova.virt.block_device [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Booting with volume daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 at /dev/vda
Aug 26 16:32:54 user nova-compute[73627]: DEBUG os_brick.utils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3931a3-df19-4beb-a572-b260b159500c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ec07f0-e85e-433d-9f9e-a1d083210f5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "41b5dc347b4d9362d0844944fe09edfb9c765171" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.966s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7df50eb-2767-469c-8865-825676780702]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[14041c32-a7fb-4656-9bf3-fed3a8b233ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:32:54 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7203af-9a10-4932-b901-7fbd7fba4a3e]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG os_brick.utils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating existing volume attachment record: 40b9245d-6156-41a3-ba67-52ad05089356 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171 --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "41b5dc347b4d9362d0844944fe09edfb9c765171" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "41b5dc347b4d9362d0844944fe09edfb9c765171" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171 --force-share --output=json" returned: 0 in 0.196s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171,backing_fmt=raw /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171,backing_fmt=raw /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk 1073741824" returned: 0 in 0.054s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "41b5dc347b4d9362d0844944fe09edfb9c765171" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171 --force-share --output=json" returned: 0 in 0.215s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'migration_context' on Instance uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:54 user nova-compute[73627]: DEBUG nova.objects.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Object Instance<b1f798a4-a09c-4a10-ba68-650b7c757f7f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:32:54 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Rebasing disk image.
Aug 26 16:32:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 -F raw /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 -F raw /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk" returned: 0 in 2.231s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Ensure instance console log exists: /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Start _get_guest_xml network_info=[{"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='24973196f98bde6ffb23318200cae4d5',container_format='bare',created_at=2023-08-26T16:30:45Z,direct_url=<?>,disk_format='qcow2',id=c23f8623-a8c0-4eca-b2f3-d630d592ec98,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1313029250-shelved',owner='93acb667ea194ce4b6f55e4e86fe9f5c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T16:30:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNolBhDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'b1f798a4-a09c-4a10-ba68-650b7c757f7f', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa965f18-ad75-4899-bbf7-c4a26cd3fa28', 'serial': 'aa965f18-ad75-4899-bbf7-c4a26cd3fa28'}, 'guest_format': None, 'attachment_id': '1a266960-fb16-4ec8-9d45-9be4a70f4dc0', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:32:57 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:32:57 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='24973196f98bde6ffb23318200cae4d5',container_format='bare',created_at=2023-08-26T16:30:45Z,direct_url=<?>,disk_format='qcow2',id=c23f8623-a8c0-4eca-b2f3-d630d592ec98,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1313029250-shelved',owner='93acb667ea194ce4b6f55e4e86fe9f5c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T16:30:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'vcpu_model' on Instance uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.objects.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Object Instance<b1f798a4-a09c-4a10-ba68-650b7c757f7f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNolBhDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:32:57 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:32:57 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:32:57 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca18f32-799a-473d-9b28-0e79a54483ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:32:57 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[480c2a80-c690-4084-9754-717d10b1aaf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28] added
Aug 26 16:32:57 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc02a094-b191-421a-b755-e2b64c79765c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1d226e-b139-4624-b0aa-5755eec67d25]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNolBhDs {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNolBhDs" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4d4c4d-6e13-48c1-b2cc-ded2b5e98150]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YNolBhDs'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c78960c-68a4-42a8-972a-6664ca84eccd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebed661a-c460-42ed-bbd6-6a6116859415]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:57 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:57 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:57 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:57 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1749f18f-649d-465d-bf69-a64177bfb57a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28, portal: 172.16.0.220,3260]
Aug 26 16:32:57 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28, portal: 172.16.0.220,3260] successful.
Aug 26 16:32:57 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d818450-cd82-42c8-861d-d0cb73c141ce]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fac148-26a5-45e1-ba1b-be227e169926]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:57 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:57 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:32:57 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:32:57 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:32:57 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:32:57 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b254d2-ec15-4be7-bf15-8512cd4196dc]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:32:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNolBhDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26433636438346136', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433636438346136', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1313029250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1313029250',id=20,image_ref='c23f8623-a8c0-4eca-b2f3-d630d592ec98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1653270261',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:28:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-8sdto70b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member',shelved_at='2023-08-26T16:30:51.100296',shelved_host='user',shelved_image_id='c23f8623-a8c0-4eca-b2f3-d630d592ec98'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:32:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=b1f798a4-a09c-4a10-ba68-650b7c757f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'pci_devices' on Instance uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.objects.base [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Object Instance<b1f798a4-a09c-4a10-ba68-650b7c757f7f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:32:58 user nova-compute[73627]:   <uuid>b1f798a4-a09c-4a10-ba68-650b7c757f7f</uuid>
Aug 26 16:32:58 user nova-compute[73627]:   <name>instance-00000014</name>
Aug 26 16:32:58 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:32:58 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:32:58 user nova-compute[73627]:   <metadata>
Aug 26 16:32:58 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:32:58 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:32:58 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1313029250</nova:name>
Aug 26 16:32:58 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:32:57</nova:creationTime>
Aug 26 16:32:58 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:32:58 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:32:58 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:32:58 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:32:58 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:32:58 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:32:58 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:32:58 user nova-compute[73627]:       <nova:owner>
Aug 26 16:32:58 user nova-compute[73627]:         <nova:user uuid="c01a881f130f4cbe9c70e2acd4842b8d">tempest-AttachVolumeShelveTestJSON-2118968964-project-member</nova:user>
Aug 26 16:32:58 user nova-compute[73627]:         <nova:project uuid="93acb667ea194ce4b6f55e4e86fe9f5c">tempest-AttachVolumeShelveTestJSON-2118968964</nova:project>
Aug 26 16:32:58 user nova-compute[73627]:       </nova:owner>
Aug 26 16:32:58 user nova-compute[73627]:       <nova:root type="image" uuid="c23f8623-a8c0-4eca-b2f3-d630d592ec98"/>
Aug 26 16:32:58 user nova-compute[73627]:       <nova:ports>
Aug 26 16:32:58 user nova-compute[73627]:         <nova:port uuid="acc0dfcd-a792-461b-890b-47ad7a7ca1e4">
Aug 26 16:32:58 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 16:32:58 user nova-compute[73627]:         </nova:port>
Aug 26 16:32:58 user nova-compute[73627]:       </nova:ports>
Aug 26 16:32:58 user nova-compute[73627]:     </nova:instance>
Aug 26 16:32:58 user nova-compute[73627]:   </metadata>
Aug 26 16:32:58 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:32:58 user nova-compute[73627]:     <system>
Aug 26 16:32:58 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:32:58 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:32:58 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:32:58 user nova-compute[73627]:       <entry name="serial">b1f798a4-a09c-4a10-ba68-650b7c757f7f</entry>
Aug 26 16:32:58 user nova-compute[73627]:       <entry name="uuid">b1f798a4-a09c-4a10-ba68-650b7c757f7f</entry>
Aug 26 16:32:58 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:32:58 user nova-compute[73627]:     </system>
Aug 26 16:32:58 user nova-compute[73627]:   </sysinfo>
Aug 26 16:32:58 user nova-compute[73627]:   <os>
Aug 26 16:32:58 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:32:58 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:32:58 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:32:58 user nova-compute[73627]:   </os>
Aug 26 16:32:58 user nova-compute[73627]:   <features>
Aug 26 16:32:58 user nova-compute[73627]:     <acpi/>
Aug 26 16:32:58 user nova-compute[73627]:     <apic/>
Aug 26 16:32:58 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:32:58 user nova-compute[73627]:   </features>
Aug 26 16:32:58 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:32:58 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:32:58 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:32:58 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:32:58 user nova-compute[73627]:   </clock>
Aug 26 16:32:58 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:32:58 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:32:58 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:32:58 user nova-compute[73627]:   </cpu>
Aug 26 16:32:58 user nova-compute[73627]:   <devices>
Aug 26 16:32:58 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:32:58 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:32:58 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk"/>
Aug 26 16:32:58 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:32:58 user nova-compute[73627]:     </disk>
Aug 26 16:32:58 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:32:58 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:32:58 user nova-compute[73627]:       <source dev="/dev/sdb"/>
Aug 26 16:32:58 user nova-compute[73627]:       <target dev="vdc" bus="virtio"/>
Aug 26 16:32:58 user nova-compute[73627]:       <serial>aa965f18-ad75-4899-bbf7-c4a26cd3fa28</serial>
Aug 26 16:32:58 user nova-compute[73627]:     </disk>
Aug 26 16:32:58 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:32:58 user nova-compute[73627]:       <mac address="fa:16:3e:10:da:20"/>
Aug 26 16:32:58 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:32:58 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:32:58 user nova-compute[73627]:       <target dev="tapacc0dfcd-a7"/>
Aug 26 16:32:58 user nova-compute[73627]:     </interface>
Aug 26 16:32:58 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:32:58 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/console.log" append="off"/>
Aug 26 16:32:58 user nova-compute[73627]:     </serial>
Aug 26 16:32:58 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:32:58 user nova-compute[73627]:     <video>
Aug 26 16:32:58 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:32:58 user nova-compute[73627]:     </video>
Aug 26 16:32:58 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:32:58 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:32:58 user nova-compute[73627]:     </rng>
Aug 26 16:32:58 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:32:58 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:32:58 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:32:58 user nova-compute[73627]:     </memballoon>
Aug 26 16:32:58 user nova-compute[73627]:   </devices>
Aug 26 16:32:58 user nova-compute[73627]: </domain>
Aug 26 16:32:58 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1313029250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1313029250',id=20,image_ref='c23f8623-a8c0-4eca-b2f3-d630d592ec98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1653270261',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:28:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-8sdto70b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member',shelved_at='2023-08-26T16:30:51.100296',shelved_host='user',shelved_image_id='c23f8623-a8c0-4eca-b2f3-d630d592ec98'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:32:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=b1f798a4-a09c-4a10-ba68-650b7c757f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG os_vif [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacc0dfcd-a7, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapacc0dfcd-a7, col_values=(('external_ids', {'iface-id': 'acc0dfcd-a792-461b-890b-47ad7a7ca1e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:da:20', 'vm-uuid': 'b1f798a4-a09c-4a10-ba68-650b7c757f7f'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:32:58 user nova-compute[73627]: INFO os_vif [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7')
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:32:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] No VIF found with MAC fa:16:3e:10:da:20, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:33:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-c89c62f7-a154-4670-8f3d-721bd873fb1b req-c39a6906-7900-4677-9315-f92012ac4208 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c89c62f7-a154-4670-8f3d-721bd873fb1b req-c39a6906-7900-4677-9315-f92012ac4208 service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c89c62f7-a154-4670-8f3d-721bd873fb1b req-c39a6906-7900-4677-9315-f92012ac4208 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c89c62f7-a154-4670-8f3d-721bd873fb1b req-c39a6906-7900-4677-9315-f92012ac4208 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-c89c62f7-a154-4670-8f3d-721bd873fb1b req-c39a6906-7900-4677-9315-f92012ac4208 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:00 user nova-compute[73627]: WARNING nova.compute.manager [req-c89c62f7-a154-4670-8f3d-721bd873fb1b req-c39a6906-7900-4677-9315-f92012ac4208 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received unexpected event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 16:33:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:02 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067582.525159, b1f798a4-a09c-4a10-ba68-650b7c757f7f => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:02 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] VM Resumed (Lifecycle Event)
Aug 26 16:33:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:33:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:33:02 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Instance spawned successfully.
Aug 26 16:33:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:33:02 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:33:02 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067582.530027, b1f798a4-a09c-4a10-ba68-650b7c757f7f => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:02 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] VM Started (Lifecycle Event)
Aug 26 16:33:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:33:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-ad1e3804-9d7a-46ce-96c8-35752ed11fe8 req-7aea5253-ad22-4490-9f39-d13228292010 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ad1e3804-9d7a-46ce-96c8-35752ed11fe8 req-7aea5253-ad22-4490-9f39-d13228292010 service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ad1e3804-9d7a-46ce-96c8-35752ed11fe8 req-7aea5253-ad22-4490-9f39-d13228292010 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ad1e3804-9d7a-46ce-96c8-35752ed11fe8 req-7aea5253-ad22-4490-9f39-d13228292010 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-ad1e3804-9d7a-46ce-96c8-35752ed11fe8 req-7aea5253-ad22-4490-9f39-d13228292010 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:02 user nova-compute[73627]: WARNING nova.compute.manager [req-ad1e3804-9d7a-46ce-96c8-35752ed11fe8 req-7aea5253-ad22-4490-9f39-d13228292010 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received unexpected event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 16:33:02 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:33:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9a287c24-b010-4a8c-96ac-dd1128289165 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.731s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:04 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:33:04 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:33:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:04 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:33:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lazy-loading 'pci_requests' on Instance uuid 02728278-ff6a-41e3-b107-6e3106a56bc4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lazy-loading 'numa_topology' on Instance uuid 02728278-ff6a-41e3-b107-6e3106a56bc4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:33:06 user nova-compute[73627]: INFO nova.compute.claims [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Claim successful on node user
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:06 user nova-compute[73627]: INFO nova.network.neutron [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating port d43b5527-a43b-4a93-88fb-db830093b5ea with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquired lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG nova.network.neutron [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-fe1ec25f-644c-469c-bcda-31b2f8b180c5 req-23339650-4e94-4d5c-a18c-7efe1f27f453 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-changed-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-fe1ec25f-644c-469c-bcda-31b2f8b180c5 req-23339650-4e94-4d5c-a18c-7efe1f27f453 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Refreshing instance network info cache due to event network-changed-d43b5527-a43b-4a93-88fb-db830093b5ea. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fe1ec25f-644c-469c-bcda-31b2f8b180c5 req-23339650-4e94-4d5c-a18c-7efe1f27f453 service nova] Acquiring lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.network.neutron [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating instance_info_cache with network_info: [{"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Releasing lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:33:08 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Creating image(s)
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Ensure instance console log exists: /opt/stack/data/nova/instances/02728278-ff6a-41e3-b107-6e3106a56bc4/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Start _get_guest_xml network_info=[{"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLTItXHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02728278-ff6a-41e3-b107-6e3106a56bc4', 'attached_at': '', 'detached_at': '', 'volume_id': 'daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837', 'serial': 'daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837'}, 'guest_format': None, 'attachment_id': '40b9245d-6156-41a3-ba67-52ad05089356', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fe1ec25f-644c-469c-bcda-31b2f8b180c5 req-23339650-4e94-4d5c-a18c-7efe1f27f453 service nova] Acquired lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.network.neutron [req-fe1ec25f-644c-469c-bcda-31b2f8b180c5 req-23339650-4e94-4d5c-a18c-7efe1f27f453 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Refreshing network info cache for port d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:33:08 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:33:08 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lazy-loading 'vcpu_model' on Instance uuid 02728278-ff6a-41e3-b107-6e3106a56bc4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.objects.base [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Object Instance<02728278-ff6a-41e3-b107-6e3106a56bc4> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLTItXHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:33:08 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:33:08 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:33:08 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd85e641-57bd-4302-8d85-ac986fb92e1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:33:08 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eff705f-f728-4900-9642-4c1e9437b463]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837] added
Aug 26 16:33:08 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c28511-073e-49c6-a6f1-499d03213b29]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[40523fd6-e462-461e-9df3-901c95d227f6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLTItXHP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLTItXHP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61b912c-7eaf-4779-a6d5-033c5a0f0d1b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QLTItXHP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd008fc5-9435-4d53-9540-5529286aac78]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[322233af-8bd8-45ba-9a26-1751e3a1cc66]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b257471-0ab4-4f81-bf8e-64b404cb2666]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260]
Aug 26 16:33:08 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260] successful.
Aug 26 16:33:08 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ed67ec-26a6-489f-bb61-7770dabaf63e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da7eaac-f4ed-4a84-bcc5-a51b5370fef0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:08 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d19c388-0019-4c67-999b-5747102c13a7]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLTItXHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-fe1ec25f-644c-469c-bcda-31b2f8b180c5 req-23339650-4e94-4d5c-a18c-7efe1f27f453 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updated VIF entry in instance network info cache for port d43b5527-a43b-4a93-88fb-db830093b5ea. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-fe1ec25f-644c-469c-bcda-31b2f8b180c5 req-23339650-4e94-4d5c-a18c-7efe1f27f453 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating instance_info_cache with network_info: [{"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fe1ec25f-644c-469c-bcda-31b2f8b180c5 req-23339650-4e94-4d5c-a18c-7efe1f27f453 service nova] Releasing lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23039613330653366', 'path': '/dev/sde'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039613330653366', 'path': '/dev/sde'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2043883167',display_name='tempest-TestShelveInstance-server-2043883167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2043883167',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1574199453',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:29:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2cb420f29dc849efa3c0b2d28ab50813',ramdisk_id='',reservation_id='r-uhsml3rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-562411929',owner_user_name='tempest-TestShelveInstance-562411929-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:32:54Z,user_data=None,user_id='419538c7a200483689e0e419b34e1489',uuid=02728278-ff6a-41e3-b107-6e3106a56bc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converting VIF {"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lazy-loading 'pci_devices' on Instance uuid 02728278-ff6a-41e3-b107-6e3106a56bc4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.objects.base [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Object Instance<02728278-ff6a-41e3-b107-6e3106a56bc4> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:33:09 user nova-compute[73627]:   <uuid>02728278-ff6a-41e3-b107-6e3106a56bc4</uuid>
Aug 26 16:33:09 user nova-compute[73627]:   <name>instance-00000016</name>
Aug 26 16:33:09 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:33:09 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:33:09 user nova-compute[73627]:   <metadata>
Aug 26 16:33:09 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:33:09 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:33:09 user nova-compute[73627]:       <nova:name>tempest-TestShelveInstance-server-2043883167</nova:name>
Aug 26 16:33:09 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:33:08</nova:creationTime>
Aug 26 16:33:09 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:33:09 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:33:09 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:33:09 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:33:09 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:33:09 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:33:09 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:33:09 user nova-compute[73627]:       <nova:owner>
Aug 26 16:33:09 user nova-compute[73627]:         <nova:user uuid="419538c7a200483689e0e419b34e1489">tempest-TestShelveInstance-562411929-project-member</nova:user>
Aug 26 16:33:09 user nova-compute[73627]:         <nova:project uuid="2cb420f29dc849efa3c0b2d28ab50813">tempest-TestShelveInstance-562411929</nova:project>
Aug 26 16:33:09 user nova-compute[73627]:       </nova:owner>
Aug 26 16:33:09 user nova-compute[73627]:       <nova:ports>
Aug 26 16:33:09 user nova-compute[73627]:         <nova:port uuid="d43b5527-a43b-4a93-88fb-db830093b5ea">
Aug 26 16:33:09 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 16:33:09 user nova-compute[73627]:         </nova:port>
Aug 26 16:33:09 user nova-compute[73627]:       </nova:ports>
Aug 26 16:33:09 user nova-compute[73627]:     </nova:instance>
Aug 26 16:33:09 user nova-compute[73627]:   </metadata>
Aug 26 16:33:09 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:33:09 user nova-compute[73627]:     <system>
Aug 26 16:33:09 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:33:09 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:33:09 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:33:09 user nova-compute[73627]:       <entry name="serial">02728278-ff6a-41e3-b107-6e3106a56bc4</entry>
Aug 26 16:33:09 user nova-compute[73627]:       <entry name="uuid">02728278-ff6a-41e3-b107-6e3106a56bc4</entry>
Aug 26 16:33:09 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:33:09 user nova-compute[73627]:     </system>
Aug 26 16:33:09 user nova-compute[73627]:   </sysinfo>
Aug 26 16:33:09 user nova-compute[73627]:   <os>
Aug 26 16:33:09 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:33:09 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:33:09 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:33:09 user nova-compute[73627]:   </os>
Aug 26 16:33:09 user nova-compute[73627]:   <features>
Aug 26 16:33:09 user nova-compute[73627]:     <acpi/>
Aug 26 16:33:09 user nova-compute[73627]:     <apic/>
Aug 26 16:33:09 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:33:09 user nova-compute[73627]:   </features>
Aug 26 16:33:09 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:33:09 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:33:09 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:33:09 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:33:09 user nova-compute[73627]:   </clock>
Aug 26 16:33:09 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:33:09 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:33:09 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:33:09 user nova-compute[73627]:   </cpu>
Aug 26 16:33:09 user nova-compute[73627]:   <devices>
Aug 26 16:33:09 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:33:09 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:33:09 user nova-compute[73627]:       <source dev="/dev/sde"/>
Aug 26 16:33:09 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:33:09 user nova-compute[73627]:       <serial>daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837</serial>
Aug 26 16:33:09 user nova-compute[73627]:     </disk>
Aug 26 16:33:09 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:33:09 user nova-compute[73627]:       <mac address="fa:16:3e:db:2d:8b"/>
Aug 26 16:33:09 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:33:09 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:33:09 user nova-compute[73627]:       <target dev="tapd43b5527-a4"/>
Aug 26 16:33:09 user nova-compute[73627]:     </interface>
Aug 26 16:33:09 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:33:09 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/02728278-ff6a-41e3-b107-6e3106a56bc4/console.log" append="off"/>
Aug 26 16:33:09 user nova-compute[73627]:     </serial>
Aug 26 16:33:09 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:33:09 user nova-compute[73627]:     <video>
Aug 26 16:33:09 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:33:09 user nova-compute[73627]:     </video>
Aug 26 16:33:09 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:33:09 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:33:09 user nova-compute[73627]:     </rng>
Aug 26 16:33:09 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:33:09 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:33:09 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:33:09 user nova-compute[73627]:     </memballoon>
Aug 26 16:33:09 user nova-compute[73627]:   </devices>
Aug 26 16:33:09 user nova-compute[73627]: </domain>
Aug 26 16:33:09 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2043883167',display_name='tempest-TestShelveInstance-server-2043883167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2043883167',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1574199453',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:29:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2cb420f29dc849efa3c0b2d28ab50813',ramdisk_id='',reservation_id='r-uhsml3rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-562411929',owner_user_name='tempest-TestShelveInstance-562411929-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:32:54Z,user_data=None,user_id='419538c7a200483689e0e419b34e1489',uuid=02728278-ff6a-41e3-b107-6e3106a56bc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converting VIF {"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG os_vif [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd43b5527-a4, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd43b5527-a4, col_values=(('external_ids', {'iface-id': 'd43b5527-a43b-4a93-88fb-db830093b5ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:2d:8b', 'vm-uuid': '02728278-ff6a-41e3-b107-6e3106a56bc4'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:09 user nova-compute[73627]: INFO os_vif [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4')
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:33:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] No VIF found with MAC fa:16:3e:db:2d:8b, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG nova.objects.instance [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'flavor' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:10 user nova-compute[73627]: INFO nova.compute.manager [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Attaching volume 713cffac-3d2b-41b3-8ac4-1b4203ec022e to /dev/vdb
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG os_brick.utils [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0078915-40c1-4339-847a-7509fa891441]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d48fb8-29b6-4603-8009-670bcdcd45d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5baa2a-a324-4624-b76c-cc96261db216]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0e15da-b8db-4b1c-8954-50704b472f02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:33:10 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f559fc-9966-4e68-a46b-d4fe982922cf]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG os_brick.utils [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updating existing volume attachment record: 978a61f8-8547-464f-9057-4447fbacd424 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067593.3785515, 02728278-ff6a-41e3-b107-6e3106a56bc4 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:13 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] VM Resumed (Lifecycle Event)
Aug 26 16:33:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.manager [req-105b69f1-6cc6-4094-9805-012ff706e95b req-439bd309-1273-4cc4-a9e0-c9d4d6674d94 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-105b69f1-6cc6-4094-9805-012ff706e95b req-439bd309-1273-4cc4-a9e0-c9d4d6674d94 service nova] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-105b69f1-6cc6-4094-9805-012ff706e95b req-439bd309-1273-4cc4-a9e0-c9d4d6674d94 service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-105b69f1-6cc6-4094-9805-012ff706e95b req-439bd309-1273-4cc4-a9e0-c9d4d6674d94 service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.manager [req-105b69f1-6cc6-4094-9805-012ff706e95b req-439bd309-1273-4cc4-a9e0-c9d4d6674d94 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] No waiting events found dispatching network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:13 user nova-compute[73627]: WARNING nova.compute.manager [req-105b69f1-6cc6-4094-9805-012ff706e95b req-439bd309-1273-4cc4-a9e0-c9d4d6674d94 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received unexpected event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.manager [req-8e8efe20-fa93-4064-b541-49027ae9d3a3 req-1c1b260d-446b-4e58-a4bc-4f6507a7fe66 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8e8efe20-fa93-4064-b541-49027ae9d3a3 req-1c1b260d-446b-4e58-a4bc-4f6507a7fe66 service nova] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8e8efe20-fa93-4064-b541-49027ae9d3a3 req-1c1b260d-446b-4e58-a4bc-4f6507a7fe66 service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8e8efe20-fa93-4064-b541-49027ae9d3a3 req-1c1b260d-446b-4e58-a4bc-4f6507a7fe66 service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.manager [req-8e8efe20-fa93-4064-b541-49027ae9d3a3 req-1c1b260d-446b-4e58-a4bc-4f6507a7fe66 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] No waiting events found dispatching network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:13 user nova-compute[73627]: WARNING nova.compute.manager [req-8e8efe20-fa93-4064-b541-49027ae9d3a3 req-1c1b260d-446b-4e58-a4bc-4f6507a7fe66 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received unexpected event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:33:13 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:33:13 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=6804MB free_disk=25.132904052734375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Instance spawned successfully.
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:13 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067593.379689, 02728278-ff6a-41e3-b107-6e3106a56bc4 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:13 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] VM Started (Lifecycle Event)
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7d9a29ce-da5e-449f-9e0e-1182b473921a tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.835s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Applying migration context for instance 19c82f60-3294-4a09-96a3-b03a1673149c as it has an incoming, in-progress migration 5b23a0b4-13c9-4c33-b0e9-6ab6fc0dffb7. Migration status is finished {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 16:33:13 user nova-compute[73627]: INFO nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating resource usage from migration 5b23a0b4-13c9-4c33-b0e9-6ab6fc0dffb7
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a20c0a68-9781-4d6c-8f55-6952f1758f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f27b7e07-8da2-4562-8ee4-5cec29543a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Migration 5b23a0b4-13c9-4c33-b0e9-6ab6fc0dffb7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19c82f60-3294-4a09-96a3-b03a1673149c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance daca1645-10d4-45e7-874a-b2972a494e6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 914c5004-52af-4826-914d-ca3d215cf040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b5277d78-3a96-4d79-8825-26d042254c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b1f798a4-a09c-4a10-ba68-650b7c757f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (8659cd71-d22c-49d8-a078-e0d0f2c22090): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:33:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:33:14 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:33:14 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:33:14 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:33:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.884s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:18 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:33:18 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:33:18 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:33:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:33:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:33:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:33:18 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:33:18 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Updating instance_info_cache with network_info: [{"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:33:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-a6f68ea4-789d-4456-a82d-d067384b566b" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:33:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:33:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:33:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:33:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:33:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:33:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:33:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:33:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:21 user nova-compute[73627]: INFO nova.compute.manager [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Terminating instance
Aug 26 16:33:21 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-427385d3-cffc-4a32-85ca-dc518afe0365 req-65493191-46f6-451e-ab95-73051269956a service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Received event network-vif-unplugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-427385d3-cffc-4a32-85ca-dc518afe0365 req-65493191-46f6-451e-ab95-73051269956a service nova] Acquiring lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-427385d3-cffc-4a32-85ca-dc518afe0365 req-65493191-46f6-451e-ab95-73051269956a service nova] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-427385d3-cffc-4a32-85ca-dc518afe0365 req-65493191-46f6-451e-ab95-73051269956a service nova] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-427385d3-cffc-4a32-85ca-dc518afe0365 req-65493191-46f6-451e-ab95-73051269956a service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] No waiting events found dispatching network-vif-unplugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-427385d3-cffc-4a32-85ca-dc518afe0365 req-65493191-46f6-451e-ab95-73051269956a service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Received event network-vif-unplugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSRMkrGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:33:22 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:33:22 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:33:22 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2441fd6-47d8-452e-8c08-dda920d656dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:33:22 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c931224-975c-4fa3-9323-dc65360aa2a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e] added
Aug 26 16:33:22 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1271c371-cd15-4714-b91b-b36aaeadab65]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe58eb3-2d97-4ab0-8b44-1aaa17ec9593]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSRMkrGi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSRMkrGi" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7a96ad-7d93-4388-911d-1eaceb3fcea0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSRMkrGi'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a519578-9a63-4815-8421-15ec755f8157]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7298af8-edcf-4c4b-925e-f08423d0bf1a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:22 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Instance destroyed successfully.
Aug 26 16:33:22 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'resources' on Instance uuid f27b7e07-8da2-4562-8ee4-5cec29543a01 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1051563310',display_name='tempest-AttachVolumeNegativeTest-server-1051563310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1051563310',id=26,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqyXPc8dPDThz3VcoIH2dWmMn0SFaQQaVq7ufPkQJJteqbMIghhJguzunpJN7ZF78wUOLhD2iId3CT7Z2je5O+gnKEYUvnEPcvuh1JSVjZgG5tL8n3p615w0cRZVaVlTQ==',key_name='tempest-keypair-2071962199',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:30:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-i11wovh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:30:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=f27b7e07-8da2-4562-8ee4-5cec29543a01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "address": "fa:16:3e:e2:ba:32", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1be10-0b", "ovs_interfaceid": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "address": "fa:16:3e:e2:ba:32", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1be10-0b", "ovs_interfaceid": "85e1be10-0bbc-46bd-87a7-7405dc3eed5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1be10-0bbc-46bd-87a7-7405dc3eed5c,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1be10-0b') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_vif [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1be10-0bbc-46bd-87a7-7405dc3eed5c,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1be10-0b') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f49a179-bc7f-4faf-a0ae-dc5788a4b53d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e, portal: 172.16.0.220,3260]
Aug 26 16:33:22 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e, portal: 172.16.0.220,3260] successful.
Aug 26 16:33:22 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85e1be10-0b, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:22 user nova-compute[73627]: INFO os_vif [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1be10-0bbc-46bd-87a7-7405dc3eed5c,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1be10-0b')
Aug 26 16:33:22 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Deleting instance files /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01_del
Aug 26 16:33:22 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Deletion of /opt/stack/data/nova/instances/f27b7e07-8da2-4562-8ee4-5cec29543a01_del complete
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bc49b7-9bc9-4295-8684-eeaa3f45e0bc]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19ec690-be78-41dc-b021-27a88c179a71]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:22 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:22 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:22 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad37d8a9-0793-4d22-8679-cee2e810649f]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSRMkrGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:33:22 user nova-compute[73627]: INFO nova.compute.manager [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 16:33:22 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:33:22 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:33:23 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:33:23 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Took 0.99 seconds to deallocate network for instance.
Aug 26 16:33:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:33:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26337343734393131', 'path': '/dev/sdf'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:33:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337343734393131', 'path': '/dev/sdf'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:33:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-e03df0d3-a2e0-41ca-90ca-4c3b9b3697de req-62b47232-c14e-4eed-9d95-6c54d1332dbe service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Received event network-vif-deleted-85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:23 user nova-compute[73627]: DEBUG nova.objects.instance [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'flavor' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:33:23 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:33:23 user nova-compute[73627]:   <source dev="/dev/sdf"/>
Aug 26 16:33:23 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:33:23 user nova-compute[73627]:   <serial>713cffac-3d2b-41b3-8ac4-1b4203ec022e</serial>
Aug 26 16:33:23 user nova-compute[73627]: </disk>
Aug 26 16:33:23 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:33:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] No VIF found with MAC fa:16:3e:65:3a:12, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.761s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-61a412ca-10b0-4d40-b7ae-7cc3b58f1356 req-175d1ff9-77bf-4c9e-b880-58510d4f832d service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Received event network-vif-plugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-61a412ca-10b0-4d40-b7ae-7cc3b58f1356 req-175d1ff9-77bf-4c9e-b880-58510d4f832d service nova] Acquiring lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-61a412ca-10b0-4d40-b7ae-7cc3b58f1356 req-175d1ff9-77bf-4c9e-b880-58510d4f832d service nova] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-61a412ca-10b0-4d40-b7ae-7cc3b58f1356 req-175d1ff9-77bf-4c9e-b880-58510d4f832d service nova] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-61a412ca-10b0-4d40-b7ae-7cc3b58f1356 req-175d1ff9-77bf-4c9e-b880-58510d4f832d service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] No waiting events found dispatching network-vif-plugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:24 user nova-compute[73627]: WARNING nova.compute.manager [req-61a412ca-10b0-4d40-b7ae-7cc3b58f1356 req-175d1ff9-77bf-4c9e-b880-58510d4f832d service nova] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Received unexpected event network-vif-plugged-85e1be10-0bbc-46bd-87a7-7405dc3eed5c for instance with vm_state deleted and task_state None.
Aug 26 16:33:24 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Deleted allocations for instance f27b7e07-8da2-4562-8ee4-5cec29543a01
Aug 26 16:33:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-55594d92-0a0a-45f5-8020-216183318a47 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.489s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c433b44-ae8a-4a0b-8ee4-f01c3693572c tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f27b7e07-8da2-4562-8ee4-5cec29543a01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.906s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:25 user nova-compute[73627]: INFO nova.compute.manager [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Rescuing
Aug 26 16:33:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:33:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquired lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:33:25 user nova-compute[73627]: DEBUG nova.network.neutron [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:33:26 user nova-compute[73627]: DEBUG nova.network.neutron [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updating instance_info_cache with network_info: [{"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:33:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Releasing lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:33:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-9f259964-0032-4a9f-b9d7-c3a628b4756f req-63a0b033-4fb0-41fe-994c-01dc22bd3cd0 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-unplugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9f259964-0032-4a9f-b9d7-c3a628b4756f req-63a0b033-4fb0-41fe-994c-01dc22bd3cd0 service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9f259964-0032-4a9f-b9d7-c3a628b4756f req-63a0b033-4fb0-41fe-994c-01dc22bd3cd0 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9f259964-0032-4a9f-b9d7-c3a628b4756f req-63a0b033-4fb0-41fe-994c-01dc22bd3cd0 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-9f259964-0032-4a9f-b9d7-c3a628b4756f req-63a0b033-4fb0-41fe-994c-01dc22bd3cd0 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-unplugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:26 user nova-compute[73627]: WARNING nova.compute.manager [req-9f259964-0032-4a9f-b9d7-c3a628b4756f req-63a0b033-4fb0-41fe-994c-01dc22bd3cd0 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received unexpected event network-vif-unplugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with vm_state active and task_state rescuing.
Aug 26 16:33:27 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Instance destroyed successfully.
Aug 26 16:33:27 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Attempting a stable device rescue
Aug 26 16:33:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73627) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 16:33:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Instance directory exists: not creating {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 16:33:27 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Creating image(s)
Aug 26 16:33:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "/opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "/opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "/opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:27 user nova-compute[73627]: DEBUG nova.objects.instance [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'trusted_certs' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "52e8f61129d1166e518576d5644264b9f02f115a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "52e8f61129d1166e518576d5644264b9f02f115a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a.part --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a.part --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG nova.virt.images [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] ae22e5b0-0f82-4b94-83b5-3f269b25d34d was qcow2, converting to raw {{(pid=73627) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a.part /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a.converted {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-d1a4587a-70ac-4239-a802-29ec95b9c3a5 req-625117a6-e013-4f4e-b9de-fe98e6365075 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d1a4587a-70ac-4239-a802-29ec95b9c3a5 req-625117a6-e013-4f4e-b9de-fe98e6365075 service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d1a4587a-70ac-4239-a802-29ec95b9c3a5 req-625117a6-e013-4f4e-b9de-fe98e6365075 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d1a4587a-70ac-4239-a802-29ec95b9c3a5 req-625117a6-e013-4f4e-b9de-fe98e6365075 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-d1a4587a-70ac-4239-a802-29ec95b9c3a5 req-625117a6-e013-4f4e-b9de-fe98e6365075 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:28 user nova-compute[73627]: WARNING nova.compute.manager [req-d1a4587a-70ac-4239-a802-29ec95b9c3a5 req-625117a6-e013-4f4e-b9de-fe98e6365075 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received unexpected event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with vm_state active and task_state rescuing.
Aug 26 16:33:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a.part /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a.converted" returned: 0 in 0.340s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a.converted --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "52e8f61129d1166e518576d5644264b9f02f115a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.089s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "52e8f61129d1166e518576d5644264b9f02f115a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "52e8f61129d1166e518576d5644264b9f02f115a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a,backing_fmt=raw /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.rescue {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a,backing_fmt=raw /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.rescue" returned: 0 in 0.049s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "52e8f61129d1166e518576d5644264b9f02f115a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.objects.instance [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'migration_context' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.objects.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Object Instance<d77a7aa1-4027-4036-b8e5-60f7fd05dfff> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Start _get_guest_xml network_info=[{"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "vif_mac": "fa:16:3e:65:3a:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ae22e5b0-0f82-4b94-83b5-3f269b25d34d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSRMkrGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd77a7aa1-4027-4036-b8e5-60f7fd05dfff', 'attached_at': '', 'detached_at': '', 'volume_id': '713cffac-3d2b-41b3-8ac4-1b4203ec022e', 'serial': '713cffac-3d2b-41b3-8ac4-1b4203ec022e'}, 'guest_format': None, 'attachment_id': '978a61f8-8547-464f-9057-4447fbacd424', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.objects.instance [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'resources' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.objects.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Object Instance<d77a7aa1-4027-4036-b8e5-60f7fd05dfff> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.objects.instance [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'numa_topology' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.objects.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Object Instance<d77a7aa1-4027-4036-b8e5-60f7fd05dfff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:29 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:33:29 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.objects.instance [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'vcpu_model' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.objects.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Object Instance<d77a7aa1-4027-4036-b8e5-60f7fd05dfff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSRMkrGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:33:29 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:33:29 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:33:29 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74f3e8b-e32f-4b8b-8a30-7395581e118d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KSRMkrGi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 16:33:29 user nova-compute[73627]: node.name = iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e
Aug 26 16:33:29 user nova-compute[73627]: node.tpgt = -1
Aug 26 16:33:29 user nova-compute[73627]: node.startup = automatic
Aug 26 16:33:29 user nova-compute[73627]: node.leading_login = No
Aug 26 16:33:29 user nova-compute[73627]: iface.iscsi_ifacename = default
Aug 26 16:33:29 user nova-compute[73627]: iface.net_ifacename = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.ipaddress = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.prefix_len = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.hwaddress = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.transport_name = tcp
Aug 26 16:33:29 user nova-compute[73627]: iface.initiatorname = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.state = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.vlan_id = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.vlan_priority = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.vlan_state = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.iface_num = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.mtu = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.port = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.bootproto = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.subnet_mask = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.gateway = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.dhcp_alt_client_id = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.dhcp_dns = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.dhcp_learn_iqn = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.dhcp_vendor_id_state = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.dhcp_vendor_id = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.dhcp_slp_da = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.fragmentation = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.gratuitous_arp = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.incoming_forwarding = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.tos_state = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.tos = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.ttl = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.delayed_ack = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.tcp_nagle = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.tcp_wsf_state = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.tcp_wsf = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.tcp_timer_scale = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.tcp_timestamp = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.redirect = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.def_task_mgmt_timeout = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.header_digest = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.data_digest = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.immediate_data = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.initial_r2t = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.data_seq_inorder = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.data_pdu_inorder = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.erl = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.max_receive_data_len = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.first_burst_len = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.max_outstanding_r2t = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.max_burst_len = 0
Aug 26 16:33:29 user nova-compute[73627]: iface.chap_auth = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.bidi_chap = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.strict_login_compliance = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.discovery_auth = <empty>
Aug 26 16:33:29 user nova-compute[73627]: iface.discovery_logout = <empty>
Aug 26 16:33:29 user nova-compute[73627]: node.discovery_address = <empty>
Aug 26 16:33:29 user nova-compute[73627]: node.discovery_port = 0
Aug 26 16:33:29 user nova-compute[73627]: node.discovery_type = static
Aug 26 16:33:29 user nova-compute[73627]: node.session.initial_cmdsn = 0
Aug 26 16:33:29 user nova-compute[73627]: node.session.initial_login_retry_max = 8
Aug 26 16:33:29 user nova-compute[73627]: node.session.xmit_thread_priority = -20
Aug 26 16:33:29 user nova-compute[73627]: node.session.cmds_max = 128
Aug 26 16:33:29 user nova-compute[73627]: node.session.queue_depth = 32
Aug 26 16:33:29 user nova-compute[73627]: node.session.nr_sessions = 1
Aug 26 16:33:29 user nova-compute[73627]: node.session.auth.authmethod = CHAP
Aug 26 16:33:29 user nova-compute[73627]: node.session.auth.username = KSRMkrGi
Aug 26 16:33:29 user nova-compute[73627]: node.session.auth.password = ***
Aug 26 16:33:29 user nova-compute[73627]: node.session.auth.username_in = <empty>
Aug 26 16:33:29 user nova-compute[73627]: node.session.auth.password_in = <empty>
Aug 26 16:33:29 user nova-compute[73627]: node.session.auth.chap_algs = MD5
Aug 26 16:33:29 user nova-compute[73627]: node.session.timeo.replacement_timeout = 120
Aug 26 16:33:29 user nova-compute[73627]: node.session.err_timeo.abort_timeout = 15
Aug 26 16:33:29 user nova-compute[73627]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 16:33:29 user nova-compute[73627]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 16:33:29 user nova-compute[73627]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 16:33:29 user nova-compute[73627]: node.session.iscsi.FastAbort = Yes
Aug 26 16:33:29 user nova-compute[73627]: node.session.iscsi.InitialR2T = No
Aug 26 16:33:29 user nova-compute[73627]: node.session.iscsi.ImmediateData = Yes
Aug 26 16:33:29 user nova-compute[73627]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 16:33:29 user nova-compute[73627]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 16:33:29 user nova-compute[73627]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 16:33:29 user nova-compute[73627]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 16:33:29 user nova-compute[73627]: node.session.iscsi.MaxConnections = 1
Aug 26 16:33:29 user nova-compute[73627]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 16:33:29 user nova-compute[73627]: node.session.iscsi.ERL = 0
Aug 26 16:33:29 user nova-compute[73627]: node.session.scan = manual
Aug 26 16:33:29 user nova-compute[73627]: node.session.reopen_max = 0
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].address = 172.16.0.220
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].port = 3260
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].startup = manual
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].tcp.window_size = 524288
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].tcp.type_of_service = 0
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].timeo.logout_timeout = 15
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].timeo.login_timeout = 15
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].timeo.auth_timeout = 45
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].iscsi.DataDigest = None
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].iscsi.IFMarker = No
Aug 26 16:33:29 user nova-compute[73627]: node.conn[0].iscsi.OFMarker = No
Aug 26 16:33:29 user nova-compute[73627]: # END RECORD
Aug 26 16:33:29 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63be526-9228-468d-8e18-d2c7ba56bf50]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd4fe49-dfbd-42d4-9014-f8dc82939c0e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSRMkrGi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSRMkrGi" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7676f93f-65b3-48a8-98c0-60e75d8411e0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSRMkrGi'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbf41f0-71c2-42d9-aa35-a8cb7a7f5b85]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[82347def-e8a3-41bc-9a49-71e2b96c83d0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:29 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:29 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:29 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:29 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:29 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:29 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:29 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:29 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:29 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:29 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] HCTL ('37', '0', '0', 0) found on session 29 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4d47d2-e110-4420-ae35-fd7d67573672]: (4, ('0 0 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Searching for a device in session 29 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSRMkrGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '26337343734393131', 'path': '/dev/sdf'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337343734393131', 'path': '/dev/sdf'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-39161320',display_name='tempest-ServerStableDeviceRescueTest-server-39161320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-39161320',id=23,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO64A3VuwOomVkMVVsLTAzcYE+ExmMEOo9bHneMgJKTrq9rsIIPhjn8kTeqDyPM4piz3MvWbnzDNLC6HZ6tFcdoM9wWYM8egwAGKQgjLwwTX7rRZor9Hr+bqZiVwfpWGkQ==',key_name='tempest-keypair-937707165',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:29:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='170fc5b72aa94714abaa09b77791cae4',ramdisk_id='',reservation_id='r-szbnyb4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1226654466',owner_user_name='tempest-ServerStableDeviceRescueTest-1226654466-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:31:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39741061f0a042a98ab5157d648683a4',uuid=d77a7aa1-4027-4036-b8e5-60f7fd05dfff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "vif_mac": "fa:16:3e:65:3a:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Converting VIF {"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "vif_mac": "fa:16:3e:65:3a:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=02c1f98d-e7ae-4afb-a56a-35cf0b0050ff,network=Network(d70def36-9f98-47bf-b769-2fc4dc16fe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c1f98d-e7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.objects.instance [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'pci_devices' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.objects.base [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Object Instance<d77a7aa1-4027-4036-b8e5-60f7fd05dfff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:33:29 user nova-compute[73627]:   <uuid>d77a7aa1-4027-4036-b8e5-60f7fd05dfff</uuid>
Aug 26 16:33:29 user nova-compute[73627]:   <name>instance-00000017</name>
Aug 26 16:33:29 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:33:29 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:33:29 user nova-compute[73627]:   <metadata>
Aug 26 16:33:29 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:33:29 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:33:29 user nova-compute[73627]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-39161320</nova:name>
Aug 26 16:33:29 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:33:29</nova:creationTime>
Aug 26 16:33:29 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:33:29 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:33:29 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:33:29 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:33:29 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:33:29 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:33:29 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:33:29 user nova-compute[73627]:       <nova:owner>
Aug 26 16:33:29 user nova-compute[73627]:         <nova:user uuid="39741061f0a042a98ab5157d648683a4">tempest-ServerStableDeviceRescueTest-1226654466-project-member</nova:user>
Aug 26 16:33:29 user nova-compute[73627]:         <nova:project uuid="170fc5b72aa94714abaa09b77791cae4">tempest-ServerStableDeviceRescueTest-1226654466</nova:project>
Aug 26 16:33:29 user nova-compute[73627]:       </nova:owner>
Aug 26 16:33:29 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:33:29 user nova-compute[73627]:       <nova:ports>
Aug 26 16:33:29 user nova-compute[73627]:         <nova:port uuid="02c1f98d-e7ae-4afb-a56a-35cf0b0050ff">
Aug 26 16:33:29 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 16:33:29 user nova-compute[73627]:         </nova:port>
Aug 26 16:33:29 user nova-compute[73627]:       </nova:ports>
Aug 26 16:33:29 user nova-compute[73627]:     </nova:instance>
Aug 26 16:33:29 user nova-compute[73627]:   </metadata>
Aug 26 16:33:29 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:33:29 user nova-compute[73627]:     <system>
Aug 26 16:33:29 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:33:29 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:33:29 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:33:29 user nova-compute[73627]:       <entry name="serial">d77a7aa1-4027-4036-b8e5-60f7fd05dfff</entry>
Aug 26 16:33:29 user nova-compute[73627]:       <entry name="uuid">d77a7aa1-4027-4036-b8e5-60f7fd05dfff</entry>
Aug 26 16:33:29 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:33:29 user nova-compute[73627]:     </system>
Aug 26 16:33:29 user nova-compute[73627]:   </sysinfo>
Aug 26 16:33:29 user nova-compute[73627]:   <os>
Aug 26 16:33:29 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:33:29 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:33:29 user nova-compute[73627]:   </os>
Aug 26 16:33:29 user nova-compute[73627]:   <features>
Aug 26 16:33:29 user nova-compute[73627]:     <acpi/>
Aug 26 16:33:29 user nova-compute[73627]:     <apic/>
Aug 26 16:33:29 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:33:29 user nova-compute[73627]:   </features>
Aug 26 16:33:29 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:33:29 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:33:29 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:33:29 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:33:29 user nova-compute[73627]:   </clock>
Aug 26 16:33:29 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:33:29 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:33:29 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:33:29 user nova-compute[73627]:   </cpu>
Aug 26 16:33:29 user nova-compute[73627]:   <devices>
Aug 26 16:33:29 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:33:29 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:33:29 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk"/>
Aug 26 16:33:29 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:33:29 user nova-compute[73627]:     </disk>
Aug 26 16:33:29 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:33:29 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:33:29 user nova-compute[73627]:       <source dev="/dev/sdf"/>
Aug 26 16:33:29 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:33:29 user nova-compute[73627]:       <serial>713cffac-3d2b-41b3-8ac4-1b4203ec022e</serial>
Aug 26 16:33:29 user nova-compute[73627]:     </disk>
Aug 26 16:33:29 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:33:29 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:33:29 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.rescue"/>
Aug 26 16:33:29 user nova-compute[73627]:       <target dev="vdc" bus="virtio"/>
Aug 26 16:33:29 user nova-compute[73627]:       <boot order="1"/>
Aug 26 16:33:29 user nova-compute[73627]:     </disk>
Aug 26 16:33:29 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:33:29 user nova-compute[73627]:       <mac address="fa:16:3e:65:3a:12"/>
Aug 26 16:33:29 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:33:29 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:33:29 user nova-compute[73627]:       <target dev="tap02c1f98d-e7"/>
Aug 26 16:33:29 user nova-compute[73627]:     </interface>
Aug 26 16:33:29 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:33:29 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/console.log" append="off"/>
Aug 26 16:33:29 user nova-compute[73627]:     </serial>
Aug 26 16:33:29 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:33:29 user nova-compute[73627]:     <video>
Aug 26 16:33:29 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:33:29 user nova-compute[73627]:     </video>
Aug 26 16:33:29 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:33:29 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:33:29 user nova-compute[73627]:     </rng>
Aug 26 16:33:29 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:33:29 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:33:29 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:33:29 user nova-compute[73627]:     </memballoon>
Aug 26 16:33:29 user nova-compute[73627]:   </devices>
Aug 26 16:33:29 user nova-compute[73627]: </domain>
Aug 26 16:33:29 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:33:29 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Instance destroyed successfully.
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:33:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] No VIF found with MAC fa:16:3e:65:3a:12, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:33:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-f36a5a15-ea16-4127-a45c-c5e542a2769f req-8c5d7220-50cd-43d3-bd01-4bfc0f0c3cfe service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f36a5a15-ea16-4127-a45c-c5e542a2769f req-8c5d7220-50cd-43d3-bd01-4bfc0f0c3cfe service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f36a5a15-ea16-4127-a45c-c5e542a2769f req-8c5d7220-50cd-43d3-bd01-4bfc0f0c3cfe service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f36a5a15-ea16-4127-a45c-c5e542a2769f req-8c5d7220-50cd-43d3-bd01-4bfc0f0c3cfe service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-f36a5a15-ea16-4127-a45c-c5e542a2769f req-8c5d7220-50cd-43d3-bd01-4bfc0f0c3cfe service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:31 user nova-compute[73627]: WARNING nova.compute.manager [req-f36a5a15-ea16-4127-a45c-c5e542a2769f req-8c5d7220-50cd-43d3-bd01-4bfc0f0c3cfe service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received unexpected event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with vm_state active and task_state rescuing.
Aug 26 16:33:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:33 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Removed pending event for d77a7aa1-4027-4036-b8e5-60f7fd05dfff due to event {{(pid=73627) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 16:33:33 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067613.485163, d77a7aa1-4027-4036-b8e5-60f7fd05dfff => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:33 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] VM Resumed (Lifecycle Event)
Aug 26 16:33:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-502ac6c6-b8d7-45b2-9823-0e248ee5a595 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:33:33 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 16:33:33 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067613.487437, d77a7aa1-4027-4036-b8e5-60f7fd05dfff => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:33 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] VM Started (Lifecycle Event)
Aug 26 16:33:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:33:33 user nova-compute[73627]: DEBUG nova.compute.manager [req-5e109716-4366-4232-84bb-5050803fca48 req-148c124e-7786-4ca6-bf0e-ec4f24ea53b2 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5e109716-4366-4232-84bb-5050803fca48 req-148c124e-7786-4ca6-bf0e-ec4f24ea53b2 service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5e109716-4366-4232-84bb-5050803fca48 req-148c124e-7786-4ca6-bf0e-ec4f24ea53b2 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5e109716-4366-4232-84bb-5050803fca48 req-148c124e-7786-4ca6-bf0e-ec4f24ea53b2 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:33 user nova-compute[73627]: DEBUG nova.compute.manager [req-5e109716-4366-4232-84bb-5050803fca48 req-148c124e-7786-4ca6-bf0e-ec4f24ea53b2 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:33 user nova-compute[73627]: WARNING nova.compute.manager [req-5e109716-4366-4232-84bb-5050803fca48 req-148c124e-7786-4ca6-bf0e-ec4f24ea53b2 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received unexpected event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with vm_state active and task_state rescuing.
Aug 26 16:33:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Port ae911fbe-6ac5-4ef1-8224-47806a42627b binding to destination host user is already ACTIVE {{(pid=73627) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 16:33:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:33:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquired lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:33:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating instance_info_cache with network_info: [{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Releasing lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Creating tmpfile /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/tmpz9hkgz9v to verify with other compute node that the instance is on the same shared storage. {{(pid=73627) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-601dd3a7-3a30-4f52-ad83-9b5f40d93d37 req-10115348-eef2-4ef1-876f-1300866ee142 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-unplugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-601dd3a7-3a30-4f52-ad83-9b5f40d93d37 req-10115348-eef2-4ef1-876f-1300866ee142 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-601dd3a7-3a30-4f52-ad83-9b5f40d93d37 req-10115348-eef2-4ef1-876f-1300866ee142 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-601dd3a7-3a30-4f52-ad83-9b5f40d93d37 req-10115348-eef2-4ef1-876f-1300866ee142 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-601dd3a7-3a30-4f52-ad83-9b5f40d93d37 req-10115348-eef2-4ef1-876f-1300866ee142 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-unplugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:36 user nova-compute[73627]: WARNING nova.compute.manager [req-601dd3a7-3a30-4f52-ad83-9b5f40d93d37 req-10115348-eef2-4ef1-876f-1300866ee142 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received unexpected event network-vif-unplugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with vm_state resized and task_state resize_reverting.
Aug 26 16:33:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:37 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance destroyed successfully.
Aug 26 16:33:37 user nova-compute[73627]: DEBUG nova.objects.instance [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lazy-loading 'resources' on Instance uuid 19c82f60-3294-4a09-96a3-b03a1673149c {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1150395174',display_name='tempest-ServerActionsTestOtherB-server-1150395174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1150395174',id=19,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsMLcp+BUGxkTU5eO6A9fURs5JKJUKrz971vfnvzmwjrONPq4qpNUgYZ+CzdRhMT1bKtdKKOR19LocoMu/yIF+ku4vNBbvF97/+zoHaRx1dCCz3qB4DhdvvVw1Om3Llw==',key_name='tempest-keypair-646039968',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:32:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc034dfcf2a3437b9b505fc54cd014a6',ramdisk_id='',reservation_id='r-c0b38pf9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1300226985',owner_user_name='tempest-ServerActionsTestOtherB-1300226985-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d633720332174fe9a29c1b7775698982',uuid=19c82f60-3294-4a09-96a3-b03a1673149c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converting VIF {"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_vif [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae911fbe-6a, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:37 user nova-compute[73627]: INFO os_vif [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a')
Aug 26 16:33:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfRpZHCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:33:37 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1f069e-03b0-4f77-9c88-4a1df37d9207]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaa7509-8c99-4cba-aac5-990a3f6297ed]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:37 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:37 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:37 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:37 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:37 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:37 user nova-compute[73627]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:37 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:37 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:37 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:37 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3f0153e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f6b2ea-157a-4d3f-884a-121b504c236b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c243250-f480-42ed-a62f-09a1ee9b7780]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f1ee9d-bc0b-4168-8f16-5700ae6dde15]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[486abc88-d7ac-4393-9615-30d9ed2dd430]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[681db240-3cef-400e-8125-cfec1e51548c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b0a27f-fb73-4ede-9c24-c861b7f520fc]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]
Aug 26 16:33:37 user nova-compute[73627]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.
Aug 26 16:33:37 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b37a35f-91b6-4f89-91b1-d9025af83bd2]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] <== disconnect_volume: return (352ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:33:37 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067602.7365031, f27b7e07-8da2-4562-8ee4-5cec29543a01 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:37 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] VM Stopped (Lifecycle Event)
Aug 26 16:33:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-14bf4267-4706-4429-9824-1213e7ba9b50 None None] [instance: f27b7e07-8da2-4562-8ee4-5cec29543a01] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-f2aa505d-7622-43c7-956c-0929e6f3594b req-9680ac18-b728-4892-ac87-6a401d1a3b75 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-changed-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-f2aa505d-7622-43c7-956c-0929e6f3594b req-9680ac18-b728-4892-ac87-6a401d1a3b75 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Refreshing instance network info cache due to event network-changed-6757dac8-c193-43e9-88cd-c4ac4d551120. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f2aa505d-7622-43c7-956c-0929e6f3594b req-9680ac18-b728-4892-ac87-6a401d1a3b75 service nova] Acquiring lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f2aa505d-7622-43c7-956c-0929e6f3594b req-9680ac18-b728-4892-ac87-6a401d1a3b75 service nova] Acquired lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG nova.network.neutron [req-f2aa505d-7622-43c7-956c-0929e6f3594b req-9680ac18-b728-4892-ac87-6a401d1a3b75 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Refreshing network info cache for port 6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG nova.objects.instance [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'flavor' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:38 user nova-compute[73627]: INFO nova.compute.manager [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Attaching volume fc099332-184b-439e-8d5d-572771e03d0a to /dev/vdb
Aug 26 16:33:38 user nova-compute[73627]: DEBUG nova.objects.instance [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lazy-loading 'migration_context' on Instance uuid 19c82f60-3294-4a09-96a3-b03a1673149c {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d976fe30-e83c-4e5a-b517-de3ca3d167fc req-ad33d612-b18f-4689-91a4-e22cc9d917a8 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d976fe30-e83c-4e5a-b517-de3ca3d167fc req-ad33d612-b18f-4689-91a4-e22cc9d917a8 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d976fe30-e83c-4e5a-b517-de3ca3d167fc req-ad33d612-b18f-4689-91a4-e22cc9d917a8 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d976fe30-e83c-4e5a-b517-de3ca3d167fc req-ad33d612-b18f-4689-91a4-e22cc9d917a8 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-d976fe30-e83c-4e5a-b517-de3ca3d167fc req-ad33d612-b18f-4689-91a4-e22cc9d917a8 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:38 user nova-compute[73627]: WARNING nova.compute.manager [req-d976fe30-e83c-4e5a-b517-de3ca3d167fc req-ad33d612-b18f-4689-91a4-e22cc9d917a8 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received unexpected event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with vm_state resized and task_state resize_reverting.
Aug 26 16:33:38 user nova-compute[73627]: DEBUG nova.objects.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Object Instance<19c82f60-3294-4a09-96a3-b03a1673149c> lazy-loaded attributes: resources,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG os_brick.utils [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0a1454-6284-483f-a9e6-2a99bcafb6e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a816c6a4-d77a-4f32-bcb3-d8b6ad93f168]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b5c093-daa3-499b-835b-cd44edb3c4b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72235e5-e6c4-4545-bc82-bbab512809ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG nova.network.neutron [req-f2aa505d-7622-43c7-956c-0929e6f3594b req-9680ac18-b728-4892-ac87-6a401d1a3b75 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updated VIF entry in instance network info cache for port 6757dac8-c193-43e9-88cd-c4ac4d551120. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG nova.network.neutron [req-f2aa505d-7622-43c7-956c-0929e6f3594b req-9680ac18-b728-4892-ac87-6a401d1a3b75 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updating instance_info_cache with network_info: [{"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:33:39 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:33:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a041338f-3505-48bd-b0c0-4fe629f21249]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG os_brick.utils [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updating existing volume attachment record: 082ac678-d83c-4c11-aea9-7f797f9164de {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f2aa505d-7622-43c7-956c-0929e6f3594b req-9680ac18-b728-4892-ac87-6a401d1a3b75 service nova] Releasing lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.807s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:39 user nova-compute[73627]: INFO nova.compute.manager [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Swapping old allocation on dict_keys(['8659cd71-d22c-49d8-a078-e0d0f2c22090']) held by migration 5b23a0b4-13c9-4c33-b0e9-6ab6fc0dffb7 for instance
Aug 26 16:33:39 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Overwriting current allocation {'allocations': {'8659cd71-d22c-49d8-a078-e0d0f2c22090': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 35}}, 'project_id': 'dc034dfcf2a3437b9b505fc54cd014a6', 'user_id': 'd633720332174fe9a29c1b7775698982', 'consumer_generation': 1} on consumer 19c82f60-3294-4a09-96a3-b03a1673149c {{(pid=73627) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquired lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:33:39 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG nova.network.neutron [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating instance_info_cache with network_info: [{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Releasing lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG os_brick.utils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d070a00e-3223-4c0e-a06f-e504a028f0bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c65f818-06cc-442f-9a3d-190c5fbfe978]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[608c2f03-40eb-4d8b-bdac-3253b0e6bc1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[82014769-7a94-4102-912a-1bf24053f4fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:33:40 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:33:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c41c0c-c6bc-4b5d-9e04-e29a245d783c]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG os_brick.utils [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:33:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:43 user nova-compute[73627]: INFO nova.compute.manager [None req-1c578297-81b8-4f69-8163-42ee17953269 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Unrescuing
Aug 26 16:33:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c578297-81b8-4f69-8163-42ee17953269 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:33:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c578297-81b8-4f69-8163-42ee17953269 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquired lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:33:43 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1c578297-81b8-4f69-8163-42ee17953269 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:33:43 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1c578297-81b8-4f69-8163-42ee17953269 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Updating instance_info_cache with network_info: [{"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:33:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c578297-81b8-4f69-8163-42ee17953269 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Releasing lock "refresh_cache-995309d1-3ec1-4ded-a2b5-5c359d2f3f48" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:33:43 user nova-compute[73627]: DEBUG nova.objects.instance [None req-1c578297-81b8-4f69-8163-42ee17953269 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'flavor' on Instance uuid 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-afcfe0b5-8ede-45c6-981a-768ecde69951 req-8194b697-a045-4964-8ea4-48f4e2acdd14 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-unplugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-afcfe0b5-8ede-45c6-981a-768ecde69951 req-8194b697-a045-4964-8ea4-48f4e2acdd14 service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-afcfe0b5-8ede-45c6-981a-768ecde69951 req-8194b697-a045-4964-8ea4-48f4e2acdd14 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-afcfe0b5-8ede-45c6-981a-768ecde69951 req-8194b697-a045-4964-8ea4-48f4e2acdd14 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-afcfe0b5-8ede-45c6-981a-768ecde69951 req-8194b697-a045-4964-8ea4-48f4e2acdd14 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-unplugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:44 user nova-compute[73627]: WARNING nova.compute.manager [req-afcfe0b5-8ede-45c6-981a-768ecde69951 req-8194b697-a045-4964-8ea4-48f4e2acdd14 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received unexpected event network-vif-unplugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:33:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:44 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Instance destroyed successfully.
Aug 26 16:33:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:46 user nova-compute[73627]: WARNING nova.compute.manager [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received unexpected event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:33:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:46 user nova-compute[73627]: WARNING nova.compute.manager [req-a1ec85f9-9d39-45da-a602-e46369e569eb req-d49abdbe-1d25-4ab0-92de-831aed8a7af1 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received unexpected event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:33:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Removed pending event for 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 due to event {{(pid=73627) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 16:33:48 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067628.2887957, 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:48 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] VM Resumed (Lifecycle Event)
Aug 26 16:33:48 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1c578297-81b8-4f69-8163-42ee17953269 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:48 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-7ae30b94-6549-4f49-924f-dead15b13404 req-fee50f66-1f19-41e7-9e35-ab8231c41056 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ae30b94-6549-4f49-924f-dead15b13404 req-fee50f66-1f19-41e7-9e35-ab8231c41056 service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ae30b94-6549-4f49-924f-dead15b13404 req-fee50f66-1f19-41e7-9e35-ab8231c41056 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ae30b94-6549-4f49-924f-dead15b13404 req-fee50f66-1f19-41e7-9e35-ab8231c41056 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-7ae30b94-6549-4f49-924f-dead15b13404 req-fee50f66-1f19-41e7-9e35-ab8231c41056 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:48 user nova-compute[73627]: WARNING nova.compute.manager [req-7ae30b94-6549-4f49-924f-dead15b13404 req-fee50f66-1f19-41e7-9e35-ab8231c41056 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received unexpected event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:33:48 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:33:48 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 16:33:48 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067628.2914152, 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:48 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] VM Started (Lifecycle Event)
Aug 26 16:33:48 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:48 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:33:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067617.1882749, 19c82f60-3294-4a09-96a3-b03a1673149c => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:52 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] VM Stopped (Lifecycle Event)
Aug 26 16:33:52 user nova-compute[73627]: DEBUG nova.compute.manager [None req-57873c9a-1b8c-4a92-bc5a-b5d500774f60 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfbhpjrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:33:52 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:33:52 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:33:52 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8112fb-aaff-495d-aae0-931bd2832aa4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:33:52 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b302ba6-568c-4ff0-8656-f13b8ac683c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a] added
Aug 26 16:33:52 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbbe2cf-7661-45bc-a4ab-60891068f4f0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ae334-4b0c-43c6-86e5-7ab5a41fb6af]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PfbhpjrW {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PfbhpjrW" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[968592bc-11d0-4692-ae46-f4055e4e3a6a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PfbhpjrW'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bff0a93-34ca-4ffd-95d7-f6f46da10ff8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a68bf1e-a388-4459-a259-95ec9d9571a4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:52 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:52 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03bb5d1-269a-4d09-82cf-0f6fefc38958]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a, portal: 172.16.0.220,3260]
Aug 26 16:33:52 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a, portal: 172.16.0.220,3260] successful.
Aug 26 16:33:52 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[69993603-693d-4e1e-991d-07effefa5d28]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd929627-0012-428b-8d7f-f63a50bcffda]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:33:52 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:52 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:33:52 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff97c5a-ba26-4027-a66e-dc5f3fca3418]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:33:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfbhpjrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Starting finish_revert_migration {{(pid=73627) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Start _get_guest_xml network_info=[{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfRpZHCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '19c82f60-3294-4a09-96a3-b03a1673149c', 'attached_at': '2023-08-26T16:33:53.000000', 'detached_at': '', 'volume_id': 'fddd40a9-9db0-4b60-b9a1-ed534dac70a9', 'serial': 'fddd40a9-9db0-4b60-b9a1-ed534dac70a9'}, 'guest_format': None, 'attachment_id': 'dba31243-c0f2-4097-9c47-569a6c2eb9b9', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:33:53 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:33:53 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.objects.instance [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lazy-loading 'vcpu_model' on Instance uuid 19c82f60-3294-4a09-96a3-b03a1673149c {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfRpZHCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:33:53 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23334633032353130', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334633032353130', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.016s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:33:53 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:33:53 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.objects.instance [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'flavor' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c94874-c225-4a89-9221-e6aad5648a05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:33:53 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:33:53 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:33:53 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:33:53 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:33:53 user nova-compute[73627]:   <serial>fc099332-184b-439e-8d5d-572771e03d0a</serial>
Aug 26 16:33:53 user nova-compute[73627]: </disk>
Aug 26 16:33:53 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[708dfcc5-2796-4d07-bc52-d3a71ad39d3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9] added
Aug 26 16:33:53 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95e5e9e-aaf5-4fb4-922e-5fd05b11cd12]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ddd759-2624-49d4-b5a6-ae43e37d8832]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfRpZHCb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfRpZHCb" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c830f86-4a36-4f55-a5fa-d1d8a197a332]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfRpZHCb'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe5fa3c-5944-4d9e-ba67-c41bc67213a7]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[382f1c14-52e2-49e5-aa5d-da92a75ba7dc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:33:53 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:33:53 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cc4236-ee85-495a-8807-c512925eeb58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]
Aug 26 16:33:53 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.
Aug 26 16:33:53 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4aa364-f804-489b-b9a1-b84b97bc0572]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d22cb5a-2334-49fd-9923-3e70108af123]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:33:53 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:33:53 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:33:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55082cd-4380-4b9e-b610-8b2ba6604d59]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:33:54 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:33:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfRpZHCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:33:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:33:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:33:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No VIF found with MAC fa:16:3e:3c:33:56, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:33:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5a87be57-3019-4053-9347-e179a7938904 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.568s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '26566343533333963', 'path': '/dev/sdg'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566343533333963', 'path': '/dev/sdg'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1150395174',display_name='tempest-ServerActionsTestOtherB-server-1150395174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1150395174',id=19,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsMLcp+BUGxkTU5eO6A9fURs5JKJUKrz971vfnvzmwjrONPq4qpNUgYZ+CzdRhMT1bKtdKKOR19LocoMu/yIF+ku4vNBbvF97/+zoHaRx1dCCz3qB4DhdvvVw1Om3Llw==',key_name='tempest-keypair-646039968',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:32:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dc034dfcf2a3437b9b505fc54cd014a6',ramdisk_id='',reservation_id='r-c0b38pf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1300226985',owner_user_name='tempest-ServerActionsTestOtherB-1300226985-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:33:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d633720332174fe9a29c1b7775698982',uuid=19c82f60-3294-4a09-96a3-b03a1673149c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converting VIF {"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:33:55 user nova-compute[73627]:   <uuid>19c82f60-3294-4a09-96a3-b03a1673149c</uuid>
Aug 26 16:33:55 user nova-compute[73627]:   <name>instance-00000013</name>
Aug 26 16:33:55 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:33:55 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:33:55 user nova-compute[73627]:   <metadata>
Aug 26 16:33:55 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:33:55 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:33:55 user nova-compute[73627]:       <nova:name>tempest-ServerActionsTestOtherB-server-1150395174</nova:name>
Aug 26 16:33:55 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:33:53</nova:creationTime>
Aug 26 16:33:55 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:33:55 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:33:55 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:33:55 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:33:55 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:33:55 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:33:55 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:33:55 user nova-compute[73627]:       <nova:owner>
Aug 26 16:33:55 user nova-compute[73627]:         <nova:user uuid="d633720332174fe9a29c1b7775698982">tempest-ServerActionsTestOtherB-1300226985-project-member</nova:user>
Aug 26 16:33:55 user nova-compute[73627]:         <nova:project uuid="dc034dfcf2a3437b9b505fc54cd014a6">tempest-ServerActionsTestOtherB-1300226985</nova:project>
Aug 26 16:33:55 user nova-compute[73627]:       </nova:owner>
Aug 26 16:33:55 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:33:55 user nova-compute[73627]:       <nova:ports>
Aug 26 16:33:55 user nova-compute[73627]:         <nova:port uuid="ae911fbe-6ac5-4ef1-8224-47806a42627b">
Aug 26 16:33:55 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 16:33:55 user nova-compute[73627]:         </nova:port>
Aug 26 16:33:55 user nova-compute[73627]:       </nova:ports>
Aug 26 16:33:55 user nova-compute[73627]:     </nova:instance>
Aug 26 16:33:55 user nova-compute[73627]:   </metadata>
Aug 26 16:33:55 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:33:55 user nova-compute[73627]:     <system>
Aug 26 16:33:55 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:33:55 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:33:55 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:33:55 user nova-compute[73627]:       <entry name="serial">19c82f60-3294-4a09-96a3-b03a1673149c</entry>
Aug 26 16:33:55 user nova-compute[73627]:       <entry name="uuid">19c82f60-3294-4a09-96a3-b03a1673149c</entry>
Aug 26 16:33:55 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:33:55 user nova-compute[73627]:     </system>
Aug 26 16:33:55 user nova-compute[73627]:   </sysinfo>
Aug 26 16:33:55 user nova-compute[73627]:   <os>
Aug 26 16:33:55 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:33:55 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:33:55 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:33:55 user nova-compute[73627]:   </os>
Aug 26 16:33:55 user nova-compute[73627]:   <features>
Aug 26 16:33:55 user nova-compute[73627]:     <acpi/>
Aug 26 16:33:55 user nova-compute[73627]:     <apic/>
Aug 26 16:33:55 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:33:55 user nova-compute[73627]:   </features>
Aug 26 16:33:55 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:33:55 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:33:55 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:33:55 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:33:55 user nova-compute[73627]:   </clock>
Aug 26 16:33:55 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:33:55 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:33:55 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:33:55 user nova-compute[73627]:   </cpu>
Aug 26 16:33:55 user nova-compute[73627]:   <devices>
Aug 26 16:33:55 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:33:55 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:33:55 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk"/>
Aug 26 16:33:55 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:33:55 user nova-compute[73627]:     </disk>
Aug 26 16:33:55 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:33:55 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:33:55 user nova-compute[73627]:       <source dev="/dev/sdg"/>
Aug 26 16:33:55 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:33:55 user nova-compute[73627]:       <serial>fddd40a9-9db0-4b60-b9a1-ed534dac70a9</serial>
Aug 26 16:33:55 user nova-compute[73627]:     </disk>
Aug 26 16:33:55 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:33:55 user nova-compute[73627]:       <mac address="fa:16:3e:4a:53:d2"/>
Aug 26 16:33:55 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:33:55 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:33:55 user nova-compute[73627]:       <target dev="tapae911fbe-6a"/>
Aug 26 16:33:55 user nova-compute[73627]:     </interface>
Aug 26 16:33:55 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:33:55 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/console.log" append="off"/>
Aug 26 16:33:55 user nova-compute[73627]:     </serial>
Aug 26 16:33:55 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:33:55 user nova-compute[73627]:     <video>
Aug 26 16:33:55 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:33:55 user nova-compute[73627]:     </video>
Aug 26 16:33:55 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:33:55 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:33:55 user nova-compute[73627]:     </rng>
Aug 26 16:33:55 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:33:55 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:33:55 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:33:55 user nova-compute[73627]:     </memballoon>
Aug 26 16:33:55 user nova-compute[73627]:   </devices>
Aug 26 16:33:55 user nova-compute[73627]: </domain>
Aug 26 16:33:55 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1150395174',display_name='tempest-ServerActionsTestOtherB-server-1150395174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1150395174',id=19,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsMLcp+BUGxkTU5eO6A9fURs5JKJUKrz971vfnvzmwjrONPq4qpNUgYZ+CzdRhMT1bKtdKKOR19LocoMu/yIF+ku4vNBbvF97/+zoHaRx1dCCz3qB4DhdvvVw1Om3Llw==',key_name='tempest-keypair-646039968',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:32:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dc034dfcf2a3437b9b505fc54cd014a6',ramdisk_id='',reservation_id='r-c0b38pf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1300226985',owner_user_name='tempest-ServerActionsTestOtherB-1300226985-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:33:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d633720332174fe9a29c1b7775698982',uuid=19c82f60-3294-4a09-96a3-b03a1673149c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converting VIF {"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG os_vif [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae911fbe-6a, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae911fbe-6a, col_values=(('external_ids', {'iface-id': 'ae911fbe-6ac5-4ef1-8224-47806a42627b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:53:d2', 'vm-uuid': '19c82f60-3294-4a09-96a3-b03a1673149c'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:55 user nova-compute[73627]: INFO os_vif [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a')
Aug 26 16:33:55 user nova-compute[73627]: INFO nova.compute.manager [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Rescuing
Aug 26 16:33:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquired lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG nova.network.neutron [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updating instance_info_cache with network_info: [{"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:33:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Releasing lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-65c7bcc6-795d-4ade-b1e8-99ecf6265842 req-40f65471-c1b4-4725-b7e7-71c693a2786f service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-unplugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-65c7bcc6-795d-4ade-b1e8-99ecf6265842 req-40f65471-c1b4-4725-b7e7-71c693a2786f service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-65c7bcc6-795d-4ade-b1e8-99ecf6265842 req-40f65471-c1b4-4725-b7e7-71c693a2786f service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-65c7bcc6-795d-4ade-b1e8-99ecf6265842 req-40f65471-c1b4-4725-b7e7-71c693a2786f service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-65c7bcc6-795d-4ade-b1e8-99ecf6265842 req-40f65471-c1b4-4725-b7e7-71c693a2786f service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-unplugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:56 user nova-compute[73627]: WARNING nova.compute.manager [req-65c7bcc6-795d-4ade-b1e8-99ecf6265842 req-40f65471-c1b4-4725-b7e7-71c693a2786f service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received unexpected event network-vif-unplugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with vm_state active and task_state rescuing.
Aug 26 16:33:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:57 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Instance destroyed successfully.
Aug 26 16:33:57 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Attempting rescue
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73627) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Instance directory exists: not creating {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 16:33:57 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Creating image(s)
Aug 26 16:33:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "/opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "/opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'trusted_certs' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.206s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.rescue {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.rescue" returned: 0 in 0.055s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'migration_context' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.objects.base [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<daca1645-10d4-45e7-874a-b2972a494e6e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Start _get_guest_xml network_info=[{"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "vif_mac": "fa:16:3e:3c:33:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'resources' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.objects.base [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<daca1645-10d4-45e7-874a-b2972a494e6e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'numa_topology' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.objects.base [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<daca1645-10d4-45e7-874a-b2972a494e6e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:57 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:33:57 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'vcpu_model' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.objects.base [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<daca1645-10d4-45e7-874a-b2972a494e6e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:31:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1675444985',display_name='tempest-ServerRescueNegativeTestJSON-server-1675444985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1675444985',id=27,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9oNjx+q/f0Zsfa9d+owmTwOfPxnAFIujBDOcAHpLpFBrMTb/9AuaTtdHxoyI837Zw0tIQiWWvz1WlumzmI3vcf2OAhWTK61Gwy/QsE2gdYqKqsvpsyXP7S8DW5XQHJNw==',key_name='tempest-keypair-801950324',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:31:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-0j9wi7yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:31:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acdf029015a64f89aa51e6559e0f962c',uuid=daca1645-10d4-45e7-874a-b2972a494e6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "vif_mac": "fa:16:3e:3c:33:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "vif_mac": "fa:16:3e:3c:33:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:33:56,bridge_name='br-int',has_traffic_filtering=True,id=6757dac8-c193-43e9-88cd-c4ac4d551120,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6757dac8-c1') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'pci_devices' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.objects.base [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Object Instance<daca1645-10d4-45e7-874a-b2972a494e6e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:33:57 user nova-compute[73627]:   <uuid>daca1645-10d4-45e7-874a-b2972a494e6e</uuid>
Aug 26 16:33:57 user nova-compute[73627]:   <name>instance-0000001b</name>
Aug 26 16:33:57 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:33:57 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:33:57 user nova-compute[73627]:   <metadata>
Aug 26 16:33:57 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:33:57 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:33:57 user nova-compute[73627]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1675444985</nova:name>
Aug 26 16:33:57 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:33:57</nova:creationTime>
Aug 26 16:33:57 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:33:57 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:33:57 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:33:57 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:33:57 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:33:57 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:33:57 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:33:57 user nova-compute[73627]:       <nova:owner>
Aug 26 16:33:57 user nova-compute[73627]:         <nova:user uuid="acdf029015a64f89aa51e6559e0f962c">tempest-ServerRescueNegativeTestJSON-1187038007-project-member</nova:user>
Aug 26 16:33:57 user nova-compute[73627]:         <nova:project uuid="9f6269e1e9de40b5a5b295651a6fd9b3">tempest-ServerRescueNegativeTestJSON-1187038007</nova:project>
Aug 26 16:33:57 user nova-compute[73627]:       </nova:owner>
Aug 26 16:33:57 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:33:57 user nova-compute[73627]:       <nova:ports>
Aug 26 16:33:57 user nova-compute[73627]:         <nova:port uuid="6757dac8-c193-43e9-88cd-c4ac4d551120">
Aug 26 16:33:57 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 16:33:57 user nova-compute[73627]:         </nova:port>
Aug 26 16:33:57 user nova-compute[73627]:       </nova:ports>
Aug 26 16:33:57 user nova-compute[73627]:     </nova:instance>
Aug 26 16:33:57 user nova-compute[73627]:   </metadata>
Aug 26 16:33:57 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:33:57 user nova-compute[73627]:     <system>
Aug 26 16:33:57 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:33:57 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:33:57 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:33:57 user nova-compute[73627]:       <entry name="serial">daca1645-10d4-45e7-874a-b2972a494e6e</entry>
Aug 26 16:33:57 user nova-compute[73627]:       <entry name="uuid">daca1645-10d4-45e7-874a-b2972a494e6e</entry>
Aug 26 16:33:57 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:33:57 user nova-compute[73627]:     </system>
Aug 26 16:33:57 user nova-compute[73627]:   </sysinfo>
Aug 26 16:33:57 user nova-compute[73627]:   <os>
Aug 26 16:33:57 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:33:57 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:33:57 user nova-compute[73627]:   </os>
Aug 26 16:33:57 user nova-compute[73627]:   <features>
Aug 26 16:33:57 user nova-compute[73627]:     <acpi/>
Aug 26 16:33:57 user nova-compute[73627]:     <apic/>
Aug 26 16:33:57 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:33:57 user nova-compute[73627]:   </features>
Aug 26 16:33:57 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:33:57 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:33:57 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:33:57 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:33:57 user nova-compute[73627]:   </clock>
Aug 26 16:33:57 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:33:57 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:33:57 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:33:57 user nova-compute[73627]:   </cpu>
Aug 26 16:33:57 user nova-compute[73627]:   <devices>
Aug 26 16:33:57 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:33:57 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:33:57 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.rescue"/>
Aug 26 16:33:57 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:33:57 user nova-compute[73627]:     </disk>
Aug 26 16:33:57 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:33:57 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:33:57 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk"/>
Aug 26 16:33:57 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:33:57 user nova-compute[73627]:     </disk>
Aug 26 16:33:57 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:33:57 user nova-compute[73627]:       <mac address="fa:16:3e:3c:33:56"/>
Aug 26 16:33:57 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:33:57 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:33:57 user nova-compute[73627]:       <target dev="tap6757dac8-c1"/>
Aug 26 16:33:57 user nova-compute[73627]:     </interface>
Aug 26 16:33:57 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:33:57 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/console.log" append="off"/>
Aug 26 16:33:57 user nova-compute[73627]:     </serial>
Aug 26 16:33:57 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:33:57 user nova-compute[73627]:     <video>
Aug 26 16:33:57 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:33:57 user nova-compute[73627]:     </video>
Aug 26 16:33:57 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:33:57 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:33:57 user nova-compute[73627]:     </rng>
Aug 26 16:33:57 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:33:57 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:33:57 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:33:57 user nova-compute[73627]:     </memballoon>
Aug 26 16:33:57 user nova-compute[73627]:   </devices>
Aug 26 16:33:57 user nova-compute[73627]: </domain>
Aug 26 16:33:57 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:33:57 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Instance destroyed successfully.
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:33:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] No VIF found with MAC fa:16:3e:3c:33:56, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:58 user nova-compute[73627]: WARNING nova.compute.manager [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received unexpected event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with vm_state active and task_state rescuing.
Aug 26 16:33:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:58 user nova-compute[73627]: WARNING nova.compute.manager [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received unexpected event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with vm_state resized and task_state resize_reverting.
Aug 26 16:33:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:33:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:33:58 user nova-compute[73627]: WARNING nova.compute.manager [req-708934aa-592b-4832-a111-42c76b4d6ae6 req-d636a3ca-5348-4923-8622-2b9a32d73cf3 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received unexpected event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with vm_state resized and task_state resize_reverting.
Aug 26 16:33:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:59 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067639.275454, 19c82f60-3294-4a09-96a3-b03a1673149c => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:59 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] VM Resumed (Lifecycle Event)
Aug 26 16:33:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:33:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance running successfully.
Aug 26 16:33:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] finish_revert_migration finished successfully. {{(pid=73627) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 26 16:33:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:33:59 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 16:33:59 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067639.2800982, 19c82f60-3294-4a09-96a3-b03a1673149c => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:33:59 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] VM Started (Lifecycle Event)
Aug 26 16:33:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:33:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:33:59 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 16:33:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:33:59 user nova-compute[73627]: INFO nova.compute.manager [None req-cb0faaec-5ddc-4f29-b988-7af32afc9c0e tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating instance to original state: 'active'
Aug 26 16:34:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:00 user nova-compute[73627]: WARNING nova.compute.manager [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received unexpected event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with vm_state active and task_state rescuing.
Aug 26 16:34:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:00 user nova-compute[73627]: WARNING nova.compute.manager [req-88b1a2e8-43df-4a5b-8f23-3c2d622c5f37 req-5529f881-7981-4619-bd56-31cad4484478 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received unexpected event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with vm_state active and task_state rescuing.
Aug 26 16:34:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Removed pending event for daca1645-10d4-45e7-874a-b2972a494e6e due to event {{(pid=73627) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 16:34:01 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067641.585596, daca1645-10d4-45e7-874a-b2972a494e6e => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:34:01 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] VM Resumed (Lifecycle Event)
Aug 26 16:34:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8c631292-b5b2-4607-bcd1-295005d847d3 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:34:01 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 16:34:01 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067641.5866866, daca1645-10d4-45e7-874a-b2972a494e6e => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:34:01 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] VM Started (Lifecycle Event)
Aug 26 16:34:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:34:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:05 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:05 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:34:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:34:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:34:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:34:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:34:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:12 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:34:12 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=6853MB free_disk=25.079212188720703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a20c0a68-9781-4d6c-8f55-6952f1758f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19c82f60-3294-4a09-96a3-b03a1673149c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance daca1645-10d4-45e7-874a-b2972a494e6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 914c5004-52af-4826-914d-ca3d215cf040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b5277d78-3a96-4d79-8825-26d042254c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b1f798a4-a09c-4a10-ba68-650b7c757f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 02728278-ff6a-41e3-b107-6e3106a56bc4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing inventories for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating ProviderTree inventory for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating inventory in ProviderTree for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing aggregate associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, aggregates: None {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 16:34:12 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing trait associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 16:34:13 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:34:13 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:34:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:34:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.929s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:13 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:13 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:13 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:34:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:34:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:34:13 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Updating instance_info_cache with network_info: [{"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73627) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 16:34:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:34:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 16:34:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] There are 0 instances to clean {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 16:34:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f9416f88-5192-4ffd-ae4b-1a521913d824" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:34:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:17 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:34:17 user nova-compute[73627]: INFO nova.compute.claims [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Claim successful on node user
Aug 26 16:34:18 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:34:18 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:34:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG nova.policy [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd643e68350c749df9a033c5ee9bae19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78924631c2e241b0b0c5cb8c9c24b4a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:34:18 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Creating image(s)
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "/opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "/opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.172s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.172s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk 1073741824" returned: 0 in 0.061s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.199s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:34:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Successfully created port: 036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Cannot resize image /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Ensure instance console log exists: /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Successfully updated port: 036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "refresh_cache-f9416f88-5192-4ffd-ae4b-1a521913d824" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquired lock "refresh_cache-f9416f88-5192-4ffd-ae4b-1a521913d824" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-27af4c01-1269-477f-b50e-9c791dea9c5e req-e6e493ce-4a96-431c-89bb-359893baef1a service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Received event network-changed-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-27af4c01-1269-477f-b50e-9c791dea9c5e req-e6e493ce-4a96-431c-89bb-359893baef1a service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Refreshing instance network info cache due to event network-changed-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-27af4c01-1269-477f-b50e-9c791dea9c5e req-e6e493ce-4a96-431c-89bb-359893baef1a service nova] Acquiring lock "refresh_cache-f9416f88-5192-4ffd-ae4b-1a521913d824" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:34:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.network.neutron [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Updating instance_info_cache with network_info: [{"id": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "address": "fa:16:3e:d9:c1:91", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036e9d53-5a", "ovs_interfaceid": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Releasing lock "refresh_cache-f9416f88-5192-4ffd-ae4b-1a521913d824" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Instance network_info: |[{"id": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "address": "fa:16:3e:d9:c1:91", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036e9d53-5a", "ovs_interfaceid": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-27af4c01-1269-477f-b50e-9c791dea9c5e req-e6e493ce-4a96-431c-89bb-359893baef1a service nova] Acquired lock "refresh_cache-f9416f88-5192-4ffd-ae4b-1a521913d824" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-27af4c01-1269-477f-b50e-9c791dea9c5e req-e6e493ce-4a96-431c-89bb-359893baef1a service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Refreshing network info cache for port 036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Start _get_guest_xml network_info=[{"id": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "address": "fa:16:3e:d9:c1:91", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036e9d53-5a", "ovs_interfaceid": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:34:20 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:34:20 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:34:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1609521558',display_name='tempest-AttachVolumeNegativeTest-server-1609521558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1609521558',id=30,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDj9IHQWS7P43+8m83fa7VMysmE5r80ULH/YKXlvrhfpGaYe802a0Vg8tB52n9f9yn5QVTzJrVkSmeOD4ZGbveG0TR4E9JtEd5G9ILpp5IYQgHAZuddY4FZ/IpbKsEd1yQ==',key_name='tempest-keypair-156072886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-wv0awocy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:34:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=f9416f88-5192-4ffd-ae4b-1a521913d824,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "address": "fa:16:3e:d9:c1:91", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036e9d53-5a", "ovs_interfaceid": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "address": "fa:16:3e:d9:c1:91", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036e9d53-5a", "ovs_interfaceid": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:91,bridge_name='br-int',has_traffic_filtering=True,id=036e9d53-5a7f-4d85-834b-0c4d4fdc7f31,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036e9d53-5a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.objects.instance [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'pci_devices' on Instance uuid f9416f88-5192-4ffd-ae4b-1a521913d824 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:34:20 user nova-compute[73627]:   <uuid>f9416f88-5192-4ffd-ae4b-1a521913d824</uuid>
Aug 26 16:34:20 user nova-compute[73627]:   <name>instance-0000001e</name>
Aug 26 16:34:20 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:34:20 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:34:20 user nova-compute[73627]:   <metadata>
Aug 26 16:34:20 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:34:20 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:34:20 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1609521558</nova:name>
Aug 26 16:34:20 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:34:20</nova:creationTime>
Aug 26 16:34:20 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:34:20 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:34:20 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:34:20 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:34:20 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:34:20 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:34:20 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:34:20 user nova-compute[73627]:       <nova:owner>
Aug 26 16:34:20 user nova-compute[73627]:         <nova:user uuid="d643e68350c749df9a033c5ee9bae19f">tempest-AttachVolumeNegativeTest-1218878917-project-member</nova:user>
Aug 26 16:34:20 user nova-compute[73627]:         <nova:project uuid="78924631c2e241b0b0c5cb8c9c24b4a4">tempest-AttachVolumeNegativeTest-1218878917</nova:project>
Aug 26 16:34:20 user nova-compute[73627]:       </nova:owner>
Aug 26 16:34:20 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:34:20 user nova-compute[73627]:       <nova:ports>
Aug 26 16:34:20 user nova-compute[73627]:         <nova:port uuid="036e9d53-5a7f-4d85-834b-0c4d4fdc7f31">
Aug 26 16:34:20 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 16:34:20 user nova-compute[73627]:         </nova:port>
Aug 26 16:34:20 user nova-compute[73627]:       </nova:ports>
Aug 26 16:34:20 user nova-compute[73627]:     </nova:instance>
Aug 26 16:34:20 user nova-compute[73627]:   </metadata>
Aug 26 16:34:20 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:34:20 user nova-compute[73627]:     <system>
Aug 26 16:34:20 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:34:20 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:34:20 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:34:20 user nova-compute[73627]:       <entry name="serial">f9416f88-5192-4ffd-ae4b-1a521913d824</entry>
Aug 26 16:34:20 user nova-compute[73627]:       <entry name="uuid">f9416f88-5192-4ffd-ae4b-1a521913d824</entry>
Aug 26 16:34:20 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:34:20 user nova-compute[73627]:     </system>
Aug 26 16:34:20 user nova-compute[73627]:   </sysinfo>
Aug 26 16:34:20 user nova-compute[73627]:   <os>
Aug 26 16:34:20 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:34:20 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:34:20 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:34:20 user nova-compute[73627]:   </os>
Aug 26 16:34:20 user nova-compute[73627]:   <features>
Aug 26 16:34:20 user nova-compute[73627]:     <acpi/>
Aug 26 16:34:20 user nova-compute[73627]:     <apic/>
Aug 26 16:34:20 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:34:20 user nova-compute[73627]:   </features>
Aug 26 16:34:20 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:34:20 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:34:20 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:34:20 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:34:20 user nova-compute[73627]:   </clock>
Aug 26 16:34:20 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:34:20 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:34:20 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:34:20 user nova-compute[73627]:   </cpu>
Aug 26 16:34:20 user nova-compute[73627]:   <devices>
Aug 26 16:34:20 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:34:20 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:34:20 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk"/>
Aug 26 16:34:20 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:34:20 user nova-compute[73627]:     </disk>
Aug 26 16:34:20 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:34:20 user nova-compute[73627]:       <mac address="fa:16:3e:d9:c1:91"/>
Aug 26 16:34:20 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:34:20 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:34:20 user nova-compute[73627]:       <target dev="tap036e9d53-5a"/>
Aug 26 16:34:20 user nova-compute[73627]:     </interface>
Aug 26 16:34:20 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:34:20 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/console.log" append="off"/>
Aug 26 16:34:20 user nova-compute[73627]:     </serial>
Aug 26 16:34:20 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:34:20 user nova-compute[73627]:     <video>
Aug 26 16:34:20 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:34:20 user nova-compute[73627]:     </video>
Aug 26 16:34:20 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:34:20 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:34:20 user nova-compute[73627]:     </rng>
Aug 26 16:34:20 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:34:20 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:34:20 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:34:20 user nova-compute[73627]:     </memballoon>
Aug 26 16:34:20 user nova-compute[73627]:   </devices>
Aug 26 16:34:20 user nova-compute[73627]: </domain>
Aug 26 16:34:20 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:34:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1609521558',display_name='tempest-AttachVolumeNegativeTest-server-1609521558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1609521558',id=30,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDj9IHQWS7P43+8m83fa7VMysmE5r80ULH/YKXlvrhfpGaYe802a0Vg8tB52n9f9yn5QVTzJrVkSmeOD4ZGbveG0TR4E9JtEd5G9ILpp5IYQgHAZuddY4FZ/IpbKsEd1yQ==',key_name='tempest-keypair-156072886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-wv0awocy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:34:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=f9416f88-5192-4ffd-ae4b-1a521913d824,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "address": "fa:16:3e:d9:c1:91", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036e9d53-5a", "ovs_interfaceid": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "address": "fa:16:3e:d9:c1:91", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036e9d53-5a", "ovs_interfaceid": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:91,bridge_name='br-int',has_traffic_filtering=True,id=036e9d53-5a7f-4d85-834b-0c4d4fdc7f31,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036e9d53-5a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG os_vif [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:91,bridge_name='br-int',has_traffic_filtering=True,id=036e9d53-5a7f-4d85-834b-0c4d4fdc7f31,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036e9d53-5a') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap036e9d53-5a, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap036e9d53-5a, col_values=(('external_ids', {'iface-id': '036e9d53-5a7f-4d85-834b-0c4d4fdc7f31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:c1:91', 'vm-uuid': 'f9416f88-5192-4ffd-ae4b-1a521913d824'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:20 user nova-compute[73627]: INFO os_vif [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:91,bridge_name='br-int',has_traffic_filtering=True,id=036e9d53-5a7f-4d85-834b-0c4d4fdc7f31,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036e9d53-5a')
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No VIF found with MAC fa:16:3e:d9:c1:91, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-27af4c01-1269-477f-b50e-9c791dea9c5e req-e6e493ce-4a96-431c-89bb-359893baef1a service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Updated VIF entry in instance network info cache for port 036e9d53-5a7f-4d85-834b-0c4d4fdc7f31. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-27af4c01-1269-477f-b50e-9c791dea9c5e req-e6e493ce-4a96-431c-89bb-359893baef1a service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Updating instance_info_cache with network_info: [{"id": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "address": "fa:16:3e:d9:c1:91", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036e9d53-5a", "ovs_interfaceid": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-27af4c01-1269-477f-b50e-9c791dea9c5e req-e6e493ce-4a96-431c-89bb-359893baef1a service nova] Releasing lock "refresh_cache-f9416f88-5192-4ffd-ae4b-1a521913d824" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-432f9584-e05a-4f6e-b8e0-d8ed8d7b62ca req-ffefaa4b-5b3a-4771-a9c6-fbde7319d9ca service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Received event network-changed-60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-432f9584-e05a-4f6e-b8e0-d8ed8d7b62ca req-ffefaa4b-5b3a-4771-a9c6-fbde7319d9ca service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Refreshing instance network info cache due to event network-changed-60dd7bfe-2839-4ce9-ba5c-df63337f418b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-432f9584-e05a-4f6e-b8e0-d8ed8d7b62ca req-ffefaa4b-5b3a-4771-a9c6-fbde7319d9ca service nova] Acquiring lock "refresh_cache-914c5004-52af-4826-914d-ca3d215cf040" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-432f9584-e05a-4f6e-b8e0-d8ed8d7b62ca req-ffefaa4b-5b3a-4771-a9c6-fbde7319d9ca service nova] Acquired lock "refresh_cache-914c5004-52af-4826-914d-ca3d215cf040" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-432f9584-e05a-4f6e-b8e0-d8ed8d7b62ca req-ffefaa4b-5b3a-4771-a9c6-fbde7319d9ca service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Refreshing network info cache for port 60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-432f9584-e05a-4f6e-b8e0-d8ed8d7b62ca req-ffefaa4b-5b3a-4771-a9c6-fbde7319d9ca service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Updated VIF entry in instance network info cache for port 60dd7bfe-2839-4ce9-ba5c-df63337f418b. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-432f9584-e05a-4f6e-b8e0-d8ed8d7b62ca req-ffefaa4b-5b3a-4771-a9c6-fbde7319d9ca service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Updating instance_info_cache with network_info: [{"id": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "address": "fa:16:3e:14:2f:bb", "network": {"id": "6c49bdb2-f5c9-4902-9d6e-9bcb5860a270", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1479283516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae57d24e815640678acc75e60a1d5412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7bfe-28", "ovs_interfaceid": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:34:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-432f9584-e05a-4f6e-b8e0-d8ed8d7b62ca req-ffefaa4b-5b3a-4771-a9c6-fbde7319d9ca service nova] Releasing lock "refresh_cache-914c5004-52af-4826-914d-ca3d215cf040" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG nova.objects.instance [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lazy-loading 'flavor' on Instance uuid 914c5004-52af-4826-914d-ca3d215cf040 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:22 user nova-compute[73627]: INFO nova.compute.manager [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Attaching volume be1bea19-8c95-459e-89f7-2c54bae9989f to /dev/vdb
Aug 26 16:34:22 user nova-compute[73627]: DEBUG os_brick.utils [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbd7623-700c-4d50-9618-82f1e7176d5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[33597bc2-a0c3-4b29-bf8f-82d73f048934]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae553579-e449-4896-bd8b-dcc5ff7253b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1332c9f-cc2e-4304-872d-5155cd8fb375]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:34:22 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:34:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[273f5734-ce8b-4f9d-9101-936aef3223df]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG os_brick.utils [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:34:22 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Updating existing volume attachment record: 4779b6e2-6ad8-4cf7-ad86-4aebc3a83fc8 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067663.8481503, f9416f88-5192-4ffd-ae4b-1a521913d824 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:34:23 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] VM Resumed (Lifecycle Event)
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:34:23 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Instance spawned successfully.
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:23 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067663.85639, f9416f88-5192-4ffd-ae4b-1a521913d824 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:34:23 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] VM Started (Lifecycle Event)
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:34:23 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:34:24 user nova-compute[73627]: INFO nova.compute.manager [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Took 5.75 seconds to spawn the instance on the hypervisor.
Aug 26 16:34:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:24 user nova-compute[73627]: INFO nova.compute.manager [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Took 6.64 seconds to build instance.
Aug 26 16:34:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f7a62d1a-6e40-4702-8cca-daac0ac5ae56 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.748s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-e9c5cbb3-f6f5-4427-a3e0-65a5efa6bfa4 req-aaeefbca-63b1-4e7b-9e7a-6f101b932dc4 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-changed-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-e9c5cbb3-f6f5-4427-a3e0-65a5efa6bfa4 req-aaeefbca-63b1-4e7b-9e7a-6f101b932dc4 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Refreshing instance network info cache due to event network-changed-e193c76c-8dac-420e-9749-9c42f62ad3cf. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:34:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e9c5cbb3-f6f5-4427-a3e0-65a5efa6bfa4 req-aaeefbca-63b1-4e7b-9e7a-6f101b932dc4 service nova] Acquiring lock "refresh_cache-b5277d78-3a96-4d79-8825-26d042254c12" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:34:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e9c5cbb3-f6f5-4427-a3e0-65a5efa6bfa4 req-aaeefbca-63b1-4e7b-9e7a-6f101b932dc4 service nova] Acquired lock "refresh_cache-b5277d78-3a96-4d79-8825-26d042254c12" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:34:24 user nova-compute[73627]: DEBUG nova.network.neutron [req-e9c5cbb3-f6f5-4427-a3e0-65a5efa6bfa4 req-aaeefbca-63b1-4e7b-9e7a-6f101b932dc4 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Refreshing network info cache for port e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:34:24 user nova-compute[73627]: DEBUG nova.network.neutron [req-e9c5cbb3-f6f5-4427-a3e0-65a5efa6bfa4 req-aaeefbca-63b1-4e7b-9e7a-6f101b932dc4 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Updated VIF entry in instance network info cache for port e193c76c-8dac-420e-9749-9c42f62ad3cf. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:34:24 user nova-compute[73627]: DEBUG nova.network.neutron [req-e9c5cbb3-f6f5-4427-a3e0-65a5efa6bfa4 req-aaeefbca-63b1-4e7b-9e7a-6f101b932dc4 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Updating instance_info_cache with network_info: [{"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:34:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e9c5cbb3-f6f5-4427-a3e0-65a5efa6bfa4 req-aaeefbca-63b1-4e7b-9e7a-6f101b932dc4 service nova] Releasing lock "refresh_cache-b5277d78-3a96-4d79-8825-26d042254c12" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:34:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG nova.objects.instance [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'flavor' on Instance uuid b5277d78-3a96-4d79-8825-26d042254c12 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:25 user nova-compute[73627]: INFO nova.compute.manager [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Attaching volume b0d891e3-b2f1-4638-9e12-cc767d416ac9 to /dev/vdb
Aug 26 16:34:25 user nova-compute[73627]: DEBUG os_brick.utils [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4800f0-872d-4d85-8852-635e5f135160]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4e537f-a84a-4794-bf17-473929bb0838]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[08472fcf-8e14-4586-a8b5-0f81bc5ca92a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa90365-6632-4d5e-8894-648a41429b80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:34:25 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6387788-f7f0-41f5-b983-1aee4d4142e4]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG os_brick.utils [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Updating existing volume attachment record: 0f74ae2c-4d48-4efb-ae29-4d84e6a1d22a {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-51344ebc-4d77-4743-ac9c-30ce8556b99a req-aeb7c637-8f68-4bb0-b09e-3d16f95c21cf service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Received event network-vif-plugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-51344ebc-4d77-4743-ac9c-30ce8556b99a req-aeb7c637-8f68-4bb0-b09e-3d16f95c21cf service nova] Acquiring lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-51344ebc-4d77-4743-ac9c-30ce8556b99a req-aeb7c637-8f68-4bb0-b09e-3d16f95c21cf service nova] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-51344ebc-4d77-4743-ac9c-30ce8556b99a req-aeb7c637-8f68-4bb0-b09e-3d16f95c21cf service nova] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-51344ebc-4d77-4743-ac9c-30ce8556b99a req-aeb7c637-8f68-4bb0-b09e-3d16f95c21cf service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] No waiting events found dispatching network-vif-plugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:25 user nova-compute[73627]: WARNING nova.compute.manager [req-51344ebc-4d77-4743-ac9c-30ce8556b99a req-aeb7c637-8f68-4bb0-b09e-3d16f95c21cf service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Received unexpected event network-vif-plugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 for instance with vm_state active and task_state None.
Aug 26 16:34:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-ead1cc86-ac28-4971-933e-2596d9755119 req-45545b88-1986-4534-ae96-929b3c4500b3 service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Received event network-vif-plugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ead1cc86-ac28-4971-933e-2596d9755119 req-45545b88-1986-4534-ae96-929b3c4500b3 service nova] Acquiring lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ead1cc86-ac28-4971-933e-2596d9755119 req-45545b88-1986-4534-ae96-929b3c4500b3 service nova] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ead1cc86-ac28-4971-933e-2596d9755119 req-45545b88-1986-4534-ae96-929b3c4500b3 service nova] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-ead1cc86-ac28-4971-933e-2596d9755119 req-45545b88-1986-4534-ae96-929b3c4500b3 service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] No waiting events found dispatching network-vif-plugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:27 user nova-compute[73627]: WARNING nova.compute.manager [req-ead1cc86-ac28-4971-933e-2596d9755119 req-45545b88-1986-4534-ae96-929b3c4500b3 service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Received unexpected event network-vif-plugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 for instance with vm_state active and task_state None.
Aug 26 16:34:27 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:34:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquired lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:34:27 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:34:27 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'info_cache' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:27 user nova-compute[73627]: DEBUG nova.objects.base [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:28 user nova-compute[73627]: INFO nova.compute.manager [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Detaching volume aa965f18-ad75-4899-bbf7-c4a26cd3fa28
Aug 26 16:34:28 user nova-compute[73627]: INFO nova.virt.block_device [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Attempting to driver detach volume aa965f18-ad75-4899-bbf7-c4a26cd3fa28 from mountpoint /dev/vdc
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Updating instance_info_cache with network_info: [{"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Attempting to detach device vdc from instance b1f798a4-a09c-4a10-ba68-650b7c757f7f from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:34:28 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:34:28 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:34:28 user nova-compute[73627]:   <target dev="vdc" bus="virtio"/>
Aug 26 16:34:28 user nova-compute[73627]:   <serial>aa965f18-ad75-4899-bbf7-c4a26cd3fa28</serial>
Aug 26 16:34:28 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 16:34:28 user nova-compute[73627]: </disk>
Aug 26 16:34:28 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Releasing lock "refresh_cache-903e3d2f-fd02-4a36-8b02-dba90b33b8f3" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:34:28 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Successfully detached device vdc from instance b1f798a4-a09c-4a10-ba68-650b7c757f7f from the persistent domain config.
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b1f798a4-a09c-4a10-ba68-650b7c757f7f from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:34:28 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:34:28 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:34:28 user nova-compute[73627]:   <target dev="vdc" bus="virtio"/>
Aug 26 16:34:28 user nova-compute[73627]:   <serial>aa965f18-ad75-4899-bbf7-c4a26cd3fa28</serial>
Aug 26 16:34:28 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 16:34:28 user nova-compute[73627]: </disk>
Aug 26 16:34:28 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:34:28 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance destroyed successfully.
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'resources' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.objects.base [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1917134968',display_name='tempest-AttachVolumeTestJSON-server-1917134968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1917134968',id=16,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmPyc6b8C0t21vVKkIWZ8TNBX7zHUhspQfWwTTrOQhl3lcjdUwR4/NQ46CDlwG3vnNcoZ8dr3nq8LPGrMhj+EHJbbjv6sYh5dC2wyhw9PPy0yzES0uh+NmbTaehI0g66w==',key_name='tempest-keypair-1635152815',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0x3g7upm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:32:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=903e3d2f-fd02-4a36-8b02-dba90b33b8f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG os_vif [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfd70b91-61, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:34:28 user nova-compute[73627]: INFO os_vif [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61')
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Start _get_guest_xml network_info=[{"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'numa_topology' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.objects.base [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:34:28 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:34:28 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'vcpu_model' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.objects.base [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1917134968',display_name='tempest-AttachVolumeTestJSON-server-1917134968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1917134968',id=16,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmPyc6b8C0t21vVKkIWZ8TNBX7zHUhspQfWwTTrOQhl3lcjdUwR4/NQ46CDlwG3vnNcoZ8dr3nq8LPGrMhj+EHJbbjv6sYh5dC2wyhw9PPy0yzES0uh+NmbTaehI0g66w==',key_name='tempest-keypair-1635152815',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0x3g7upm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:32:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=903e3d2f-fd02-4a36-8b02-dba90b33b8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'pci_devices' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.objects.base [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:34:28 user nova-compute[73627]:   <uuid>903e3d2f-fd02-4a36-8b02-dba90b33b8f3</uuid>
Aug 26 16:34:28 user nova-compute[73627]:   <name>instance-00000010</name>
Aug 26 16:34:28 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:34:28 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:34:28 user nova-compute[73627]:   <metadata>
Aug 26 16:34:28 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:34:28 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:34:28 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeTestJSON-server-1917134968</nova:name>
Aug 26 16:34:28 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:34:28</nova:creationTime>
Aug 26 16:34:28 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:34:28 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:34:28 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:34:28 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:34:28 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:34:28 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:34:28 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:34:28 user nova-compute[73627]:       <nova:owner>
Aug 26 16:34:28 user nova-compute[73627]:         <nova:user uuid="5067f58846cf44fc9799db04de44d116">tempest-AttachVolumeTestJSON-1152498749-project-member</nova:user>
Aug 26 16:34:28 user nova-compute[73627]:         <nova:project uuid="875ad08232174cb391be66a7d5605d8d">tempest-AttachVolumeTestJSON-1152498749</nova:project>
Aug 26 16:34:28 user nova-compute[73627]:       </nova:owner>
Aug 26 16:34:28 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:34:28 user nova-compute[73627]:       <nova:ports>
Aug 26 16:34:28 user nova-compute[73627]:         <nova:port uuid="cfd70b91-61a4-4ad8-9354-412fb74106c1">
Aug 26 16:34:28 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 16:34:28 user nova-compute[73627]:         </nova:port>
Aug 26 16:34:28 user nova-compute[73627]:       </nova:ports>
Aug 26 16:34:28 user nova-compute[73627]:     </nova:instance>
Aug 26 16:34:28 user nova-compute[73627]:   </metadata>
Aug 26 16:34:28 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:34:28 user nova-compute[73627]:     <system>
Aug 26 16:34:28 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:34:28 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:34:28 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:34:28 user nova-compute[73627]:       <entry name="serial">903e3d2f-fd02-4a36-8b02-dba90b33b8f3</entry>
Aug 26 16:34:28 user nova-compute[73627]:       <entry name="uuid">903e3d2f-fd02-4a36-8b02-dba90b33b8f3</entry>
Aug 26 16:34:28 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:34:28 user nova-compute[73627]:     </system>
Aug 26 16:34:28 user nova-compute[73627]:   </sysinfo>
Aug 26 16:34:28 user nova-compute[73627]:   <os>
Aug 26 16:34:28 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:34:28 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:34:28 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:34:28 user nova-compute[73627]:   </os>
Aug 26 16:34:28 user nova-compute[73627]:   <features>
Aug 26 16:34:28 user nova-compute[73627]:     <acpi/>
Aug 26 16:34:28 user nova-compute[73627]:     <apic/>
Aug 26 16:34:28 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:34:28 user nova-compute[73627]:   </features>
Aug 26 16:34:28 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:34:28 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:34:28 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:34:28 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:34:28 user nova-compute[73627]:   </clock>
Aug 26 16:34:28 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:34:28 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:34:28 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:34:28 user nova-compute[73627]:   </cpu>
Aug 26 16:34:28 user nova-compute[73627]:   <devices>
Aug 26 16:34:28 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:34:28 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:34:28 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk"/>
Aug 26 16:34:28 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:34:28 user nova-compute[73627]:     </disk>
Aug 26 16:34:28 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:34:28 user nova-compute[73627]:       <mac address="fa:16:3e:d1:9a:8b"/>
Aug 26 16:34:28 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:34:28 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:34:28 user nova-compute[73627]:       <target dev="tapcfd70b91-61"/>
Aug 26 16:34:28 user nova-compute[73627]:     </interface>
Aug 26 16:34:28 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:34:28 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/console.log" append="off"/>
Aug 26 16:34:28 user nova-compute[73627]:     </serial>
Aug 26 16:34:28 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:34:28 user nova-compute[73627]:     <video>
Aug 26 16:34:28 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:34:28 user nova-compute[73627]:     </video>
Aug 26 16:34:28 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:34:28 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:34:28 user nova-compute[73627]:     </rng>
Aug 26 16:34:28 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:34:28 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:34:28 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:34:28 user nova-compute[73627]:     </memballoon>
Aug 26 16:34:28 user nova-compute[73627]:   </devices>
Aug 26 16:34:28 user nova-compute[73627]: </domain>
Aug 26 16:34:28 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067669.0763557, b1f798a4-a09c-4a10-ba68-650b7c757f7f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:34:29 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Successfully detached device vdc from instance b1f798a4-a09c-4a10-ba68-650b7c757f7f from the live domain config.
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNolBhDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:34:29 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[312d8769-a476-4eab-9aaf-b711321424aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[50701070-c563-4834-aa48-9cb37c2b18b6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:29 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:34:29 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:29 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:29 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:29 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:29 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:29 user nova-compute[73627]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 (non-flash)
Aug 26 16:34:29 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:29 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:29 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:29 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:29 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e8399870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c104c9a2-fa6c-4f46-8426-d4be4bb9b7a0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'trusted_certs' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.objects.base [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bb4dfe-a14b-4b7d-b68a-e0d5104d9a03]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[012bb81e-63a8-4caa-b9bd-8e2bcaaf8a9b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[537307c0-1039-4bbd-b43e-d0db05df74af]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4fdc4-a843-4d4b-a52f-effc19f30aee]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b27931-671d-48bf-a866-4b4624c8b412]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28, portal: 172.16.0.220,3260]
Aug 26 16:34:29 user nova-compute[73627]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28, portal: 172.16.0.220,3260] successful.
Aug 26 16:34:29 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa965f18-ad75-4899-bbf7-c4a26cd3fa28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[073edead-3fb3-4d04-a813-78c16f8791fb]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] <== disconnect_volume: return (444ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Cannot resize image /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'migration_context' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.objects.base [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Object Instance<903e3d2f-fd02-4a36-8b02-dba90b33b8f3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1917134968',display_name='tempest-AttachVolumeTestJSON-server-1917134968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1917134968',id=16,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmPyc6b8C0t21vVKkIWZ8TNBX7zHUhspQfWwTTrOQhl3lcjdUwR4/NQ46CDlwG3vnNcoZ8dr3nq8LPGrMhj+EHJbbjv6sYh5dC2wyhw9PPy0yzES0uh+NmbTaehI0g66w==',key_name='tempest-keypair-1635152815',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0x3g7upm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:32:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=903e3d2f-fd02-4a36-8b02-dba90b33b8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG os_vif [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfd70b91-61, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfd70b91-61, col_values=(('external_ids', {'iface-id': 'cfd70b91-61a4-4ad8-9354-412fb74106c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:9a:8b', 'vm-uuid': '903e3d2f-fd02-4a36-8b02-dba90b33b8f3'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:34:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:29 user nova-compute[73627]: INFO os_vif [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61')
Aug 26 16:34:30 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'flavor' on Instance uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7854cfa7-b8ef-4f85-b36d-87f181cfd46e tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.118s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-6b106996-d6df-41f9-9d05-3f29fd337f2d req-329ba170-67f6-4821-a8d7-6e4368097e07 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6b106996-d6df-41f9-9d05-3f29fd337f2d req-329ba170-67f6-4821-a8d7-6e4368097e07 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6b106996-d6df-41f9-9d05-3f29fd337f2d req-329ba170-67f6-4821-a8d7-6e4368097e07 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6b106996-d6df-41f9-9d05-3f29fd337f2d req-329ba170-67f6-4821-a8d7-6e4368097e07 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-6b106996-d6df-41f9-9d05-3f29fd337f2d req-329ba170-67f6-4821-a8d7-6e4368097e07 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:31 user nova-compute[73627]: WARNING nova.compute.manager [req-6b106996-d6df-41f9-9d05-3f29fd337f2d req-329ba170-67f6-4821-a8d7-6e4368097e07 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state stopped and task_state powering-on.
Aug 26 16:34:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:33 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067673.5667505, 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:34:33 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] VM Resumed (Lifecycle Event)
Aug 26 16:34:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:34:33 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance rebooted successfully.
Aug 26 16:34:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6cc66550-b73e-4948-9b9d-c9eecaac3f49 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:34:33 user nova-compute[73627]: DEBUG nova.compute.manager [req-9e1e7a7d-ac33-4e10-a7df-6b973d3ba153 req-fcf8e2c3-359e-4656-9315-0b87ec491074 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e1e7a7d-ac33-4e10-a7df-6b973d3ba153 req-fcf8e2c3-359e-4656-9315-0b87ec491074 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e1e7a7d-ac33-4e10-a7df-6b973d3ba153 req-fcf8e2c3-359e-4656-9315-0b87ec491074 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e1e7a7d-ac33-4e10-a7df-6b973d3ba153 req-fcf8e2c3-359e-4656-9315-0b87ec491074 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:33 user nova-compute[73627]: DEBUG nova.compute.manager [req-9e1e7a7d-ac33-4e10-a7df-6b973d3ba153 req-fcf8e2c3-359e-4656-9315-0b87ec491074 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:33 user nova-compute[73627]: WARNING nova.compute.manager [req-9e1e7a7d-ac33-4e10-a7df-6b973d3ba153 req-fcf8e2c3-359e-4656-9315-0b87ec491074 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state stopped and task_state powering-on.
Aug 26 16:34:33 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 16:34:33 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067673.568458, 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:34:33 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] VM Started (Lifecycle Event)
Aug 26 16:34:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:34:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:34:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:35 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:34:35 user nova-compute[73627]: INFO nova.compute.claims [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Claim successful on node user
Aug 26 16:34:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrJAouIl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:34:36 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:34:36 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:34:36 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5517cb64-222f-481a-9703-4ee94288b1e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:34:36 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bf7c4f-0b5a-4e3a-b941-589f78b30b8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f] added
Aug 26 16:34:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7c8c95-7777-4782-a819-8f3bb45685c7]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a27569-3b07-4aba-8b96-3a17aacfe4d8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yrJAouIl {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:36 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yrJAouIl" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[20865c4f-d546-4673-becf-f02be762164b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yrJAouIl'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ce6761-6451-4694-9b00-20744c9decad]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0cf3bb-c25c-459c-86d8-411d27d67675]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG nova.policy [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a676ca6fc331417d8f835ebcf8181cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c5a07134941420ba915917e23449851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd21279-2f3f-4c8e-9df7-0f7495fc4420]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f, portal: 172.16.0.220,3260]
Aug 26 16:34:36 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f, portal: 172.16.0.220,3260] successful.
Aug 26 16:34:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:34:36 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Creating image(s)
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "/opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "/opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "3340449c97da6e2f1518b4146e3bab7d8938b522" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "3340449c97da6e2f1518b4146e3bab7d8938b522" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5398912e-23ac-431f-b116-6bbf0112a6bf]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22d57bf-8c5e-4875-b9e6-8d5dbe0a15be]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:36 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:36 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1431d7-27df-4089-b4f9-33d3e88935a9]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrJAouIl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:34:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522.part --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Successfully created port: 9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522.part --force-share --output=json" returned: 0 in 0.242s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG nova.virt.images [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] 53282c5c-8791-40e6-b0f8-6ba17d690089 was qcow2, converting to raw {{(pid=73627) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522.part /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522.converted {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522.part /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522.converted" returned: 0 in 0.255s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522.converted --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26666393630393431', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666393630393431', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG nova.objects.instance [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lazy-loading 'flavor' on Instance uuid 914c5004-52af-4826-914d-ca3d215cf040 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:34:37 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:34:37 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:34:37 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:34:37 user nova-compute[73627]:   <serial>be1bea19-8c95-459e-89f7-2c54bae9989f</serial>
Aug 26 16:34:37 user nova-compute[73627]: </disk>
Aug 26 16:34:37 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "3340449c97da6e2f1518b4146e3bab7d8938b522" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.141s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522 --force-share --output=json" returned: 0 in 0.213s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "3340449c97da6e2f1518b4146e3bab7d8938b522" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "3340449c97da6e2f1518b4146e3bab7d8938b522" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Successfully updated port: 9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquired lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG nova.compute.manager [req-73a45363-09fe-414f-aace-306f41b4424d req-ca48beee-34bd-48b0-86ed-0cbf189a5d76 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-changed-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG nova.compute.manager [req-73a45363-09fe-414f-aace-306f41b4424d req-ca48beee-34bd-48b0-86ed-0cbf189a5d76 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Refreshing instance network info cache due to event network-changed-9f3a452b-b466-40bd-809e-38d61cd3ba5e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:34:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-73a45363-09fe-414f-aace-306f41b4424d req-ca48beee-34bd-48b0-86ed-0cbf189a5d76 service nova] Acquiring lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522 --force-share --output=json" returned: 0 in 0.203s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522,backing_fmt=raw /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522,backing_fmt=raw /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk 1073741824" returned: 0 in 0.056s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "3340449c97da6e2f1518b4146e3bab7d8938b522" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] No VIF found with MAC fa:16:3e:14:2f:bb, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522 --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-68328d2c-2e2c-4fcd-925f-596bdc780b88 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.031s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updating instance_info_cache with network_info: [{"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Cannot resize image /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Ensure instance console log exists: /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Releasing lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Instance network_info: |[{"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-73a45363-09fe-414f-aace-306f41b4424d req-ca48beee-34bd-48b0-86ed-0cbf189a5d76 service nova] Acquired lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.network.neutron [req-73a45363-09fe-414f-aace-306f41b4424d req-ca48beee-34bd-48b0-86ed-0cbf189a5d76 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Refreshing network info cache for port 9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Start _get_guest_xml network_info=[{"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:34:32Z,direct_url=<?>,disk_format='qcow2',id=53282c5c-8791-40e6-b0f8-6ba17d690089,min_disk=0,min_ram=0,name='tempest-scenario-img--1179505850',owner='0c5a07134941420ba915917e23449851',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:34:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '53282c5c-8791-40e6-b0f8-6ba17d690089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:34:38 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:34:38 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:34:32Z,direct_url=<?>,disk_format='qcow2',id=53282c5c-8791-40e6-b0f8-6ba17d690089,min_disk=0,min_ram=0,name='tempest-scenario-img--1179505850',owner='0c5a07134941420ba915917e23449851',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:34:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401986763',display_name='tempest-TestMinimumBasicScenario-server-1401986763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401986763',id=31,image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvGb6OgS4/exGLauNisDrmDk77vIvVYHyzKMvy12SdxmWjlFxuHxBz+ABfkBoNAITGCTjFnOALKtOiV1awPZM4LY5xuhILyJgwDK9Pu86m2c2Mbjfxy5ew/i3hBTH56bA==',key_name='tempest-TestMinimumBasicScenario-1334019721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c5a07134941420ba915917e23449851',ramdisk_id='',reservation_id='r-ym847cwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-808712581',owner_user_name='tempest-TestMinimumBasicScenario-808712581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:34:36Z,user_data=None,user_id='a676ca6fc331417d8f835ebcf8181cfb',uuid=8e049438-4a89-4bc9-bd98-397c8c699fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converting VIF {"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.objects.instance [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:34:38 user nova-compute[73627]:   <uuid>8e049438-4a89-4bc9-bd98-397c8c699fc9</uuid>
Aug 26 16:34:38 user nova-compute[73627]:   <name>instance-0000001f</name>
Aug 26 16:34:38 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:34:38 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:34:38 user nova-compute[73627]:   <metadata>
Aug 26 16:34:38 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:34:38 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:34:38 user nova-compute[73627]:       <nova:name>tempest-TestMinimumBasicScenario-server-1401986763</nova:name>
Aug 26 16:34:38 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:34:38</nova:creationTime>
Aug 26 16:34:38 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:34:38 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:34:38 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:34:38 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:34:38 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:34:38 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:34:38 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:34:38 user nova-compute[73627]:       <nova:owner>
Aug 26 16:34:38 user nova-compute[73627]:         <nova:user uuid="a676ca6fc331417d8f835ebcf8181cfb">tempest-TestMinimumBasicScenario-808712581-project-member</nova:user>
Aug 26 16:34:38 user nova-compute[73627]:         <nova:project uuid="0c5a07134941420ba915917e23449851">tempest-TestMinimumBasicScenario-808712581</nova:project>
Aug 26 16:34:38 user nova-compute[73627]:       </nova:owner>
Aug 26 16:34:38 user nova-compute[73627]:       <nova:root type="image" uuid="53282c5c-8791-40e6-b0f8-6ba17d690089"/>
Aug 26 16:34:38 user nova-compute[73627]:       <nova:ports>
Aug 26 16:34:38 user nova-compute[73627]:         <nova:port uuid="9f3a452b-b466-40bd-809e-38d61cd3ba5e">
Aug 26 16:34:38 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 16:34:38 user nova-compute[73627]:         </nova:port>
Aug 26 16:34:38 user nova-compute[73627]:       </nova:ports>
Aug 26 16:34:38 user nova-compute[73627]:     </nova:instance>
Aug 26 16:34:38 user nova-compute[73627]:   </metadata>
Aug 26 16:34:38 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:34:38 user nova-compute[73627]:     <system>
Aug 26 16:34:38 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:34:38 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:34:38 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:34:38 user nova-compute[73627]:       <entry name="serial">8e049438-4a89-4bc9-bd98-397c8c699fc9</entry>
Aug 26 16:34:38 user nova-compute[73627]:       <entry name="uuid">8e049438-4a89-4bc9-bd98-397c8c699fc9</entry>
Aug 26 16:34:38 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:34:38 user nova-compute[73627]:     </system>
Aug 26 16:34:38 user nova-compute[73627]:   </sysinfo>
Aug 26 16:34:38 user nova-compute[73627]:   <os>
Aug 26 16:34:38 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:34:38 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:34:38 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:34:38 user nova-compute[73627]:   </os>
Aug 26 16:34:38 user nova-compute[73627]:   <features>
Aug 26 16:34:38 user nova-compute[73627]:     <acpi/>
Aug 26 16:34:38 user nova-compute[73627]:     <apic/>
Aug 26 16:34:38 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:34:38 user nova-compute[73627]:   </features>
Aug 26 16:34:38 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:34:38 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:34:38 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:34:38 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:34:38 user nova-compute[73627]:   </clock>
Aug 26 16:34:38 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:34:38 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:34:38 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:34:38 user nova-compute[73627]:   </cpu>
Aug 26 16:34:38 user nova-compute[73627]:   <devices>
Aug 26 16:34:38 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:34:38 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:34:38 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk"/>
Aug 26 16:34:38 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:34:38 user nova-compute[73627]:     </disk>
Aug 26 16:34:38 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:34:38 user nova-compute[73627]:       <mac address="fa:16:3e:6e:27:2c"/>
Aug 26 16:34:38 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:34:38 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:34:38 user nova-compute[73627]:       <target dev="tap9f3a452b-b4"/>
Aug 26 16:34:38 user nova-compute[73627]:     </interface>
Aug 26 16:34:38 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:34:38 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/console.log" append="off"/>
Aug 26 16:34:38 user nova-compute[73627]:     </serial>
Aug 26 16:34:38 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:34:38 user nova-compute[73627]:     <video>
Aug 26 16:34:38 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:34:38 user nova-compute[73627]:     </video>
Aug 26 16:34:38 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:34:38 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:34:38 user nova-compute[73627]:     </rng>
Aug 26 16:34:38 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:34:38 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:34:38 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:34:38 user nova-compute[73627]:     </memballoon>
Aug 26 16:34:38 user nova-compute[73627]:   </devices>
Aug 26 16:34:38 user nova-compute[73627]: </domain>
Aug 26 16:34:38 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401986763',display_name='tempest-TestMinimumBasicScenario-server-1401986763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401986763',id=31,image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvGb6OgS4/exGLauNisDrmDk77vIvVYHyzKMvy12SdxmWjlFxuHxBz+ABfkBoNAITGCTjFnOALKtOiV1awPZM4LY5xuhILyJgwDK9Pu86m2c2Mbjfxy5ew/i3hBTH56bA==',key_name='tempest-TestMinimumBasicScenario-1334019721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c5a07134941420ba915917e23449851',ramdisk_id='',reservation_id='r-ym847cwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-808712581',owner_user_name='tempest-TestMinimumBasicScenario-808712581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:34:36Z,user_data=None,user_id='a676ca6fc331417d8f835ebcf8181cfb',uuid=8e049438-4a89-4bc9-bd98-397c8c699fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converting VIF {"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG os_vif [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f3a452b-b4, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f3a452b-b4, col_values=(('external_ids', {'iface-id': '9f3a452b-b466-40bd-809e-38d61cd3ba5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:27:2c', 'vm-uuid': '8e049438-4a89-4bc9-bd98-397c8c699fc9'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:38 user nova-compute[73627]: INFO os_vif [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4')
Aug 26 16:34:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYEBtHkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:34:38 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:34:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:34:38 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:34:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:34:38 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a8507f-deb5-4feb-a76d-9a3d543102d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:34:38 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4e3449-a532-4070-b971-1543bb3e554d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9] added
Aug 26 16:34:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[056c47f5-2587-4669-a42f-cb1057fa7a5e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] No VIF found with MAC fa:16:3e:6e:27:2c, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ea60c0-18ad-4aa0-9a48-330f94dd7f37]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYEBtHkp {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYEBtHkp" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff86fb4-ca0a-47d7-905d-5e77c989dd0d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gYEBtHkp'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b648a710-7218-48db-9eb0-87779a799f6f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0895098f-492b-4bf5-b47a-2bd15561ce97]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5afe36-b887-408d-8194-b3c0fb13d80a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260]
Aug 26 16:34:39 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260] successful.
Aug 26 16:34:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada8a235-2db9-4542-92cf-6b10afdf3d2a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d2b10f-5133-4554-8e56-595177742d14]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:39 user nova-compute[73627]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:34:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] HCTL ('39', '-', '-', 0) found on session 33 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8ba73-39e1-45b8-ac5d-619105ee7da1]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching for a device in session 33 and hctl ['39', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG nova.network.neutron [req-73a45363-09fe-414f-aace-306f41b4424d req-ca48beee-34bd-48b0-86ed-0cbf189a5d76 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updated VIF entry in instance network info cache for port 9f3a452b-b466-40bd-809e-38d61cd3ba5e. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:34:39 user nova-compute[73627]: DEBUG nova.network.neutron [req-73a45363-09fe-414f-aace-306f41b4424d req-ca48beee-34bd-48b0-86ed-0cbf189a5d76 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updating instance_info_cache with network_info: [{"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-73a45363-09fe-414f-aace-306f41b4424d req-ca48beee-34bd-48b0-86ed-0cbf189a5d76 service nova] Releasing lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching for a device in session 33 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYEBtHkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23336303635376133', 'path': '/dev/sdh'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336303635376133', 'path': '/dev/sdh'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG nova.objects.instance [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'flavor' on Instance uuid b5277d78-3a96-4d79-8825-26d042254c12 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:34:40 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:34:40 user nova-compute[73627]:   <source dev="/dev/sdh"/>
Aug 26 16:34:40 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:34:40 user nova-compute[73627]:   <serial>b0d891e3-b2f1-4638-9e12-cc767d416ac9</serial>
Aug 26 16:34:40 user nova-compute[73627]: </disk>
Aug 26 16:34:40 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-42574c74-2f47-4694-af14-9c5fd8922836 req-19d44d69-ac6b-49f8-befc-bd165a64845e service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42574c74-2f47-4694-af14-9c5fd8922836 req-19d44d69-ac6b-49f8-befc-bd165a64845e service nova] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42574c74-2f47-4694-af14-9c5fd8922836 req-19d44d69-ac6b-49f8-befc-bd165a64845e service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42574c74-2f47-4694-af14-9c5fd8922836 req-19d44d69-ac6b-49f8-befc-bd165a64845e service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-42574c74-2f47-4694-af14-9c5fd8922836 req-19d44d69-ac6b-49f8-befc-bd165a64845e service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] No waiting events found dispatching network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:40 user nova-compute[73627]: WARNING nova.compute.manager [req-42574c74-2f47-4694-af14-9c5fd8922836 req-19d44d69-ac6b-49f8-befc-bd165a64845e service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received unexpected event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e for instance with vm_state building and task_state spawning.
Aug 26 16:34:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:34:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:34:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No VIF found with MAC fa:16:3e:cd:6e:eb, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:34:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-75990e1a-a522-4005-85ac-13a0c6e2ee10 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.070s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:42 user nova-compute[73627]: INFO nova.compute.manager [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Rebuilding instance
Aug 26 16:34:42 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-353d4f3a-9418-4a8b-8561-405667ece628 req-f59abe7f-01db-45c6-b666-fd8891560c3a service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-vif-unplugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-353d4f3a-9418-4a8b-8561-405667ece628 req-f59abe7f-01db-45c6-b666-fd8891560c3a service nova] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-353d4f3a-9418-4a8b-8561-405667ece628 req-f59abe7f-01db-45c6-b666-fd8891560c3a service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-353d4f3a-9418-4a8b-8561-405667ece628 req-f59abe7f-01db-45c6-b666-fd8891560c3a service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-353d4f3a-9418-4a8b-8561-405667ece628 req-f59abe7f-01db-45c6-b666-fd8891560c3a service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] No waiting events found dispatching network-vif-unplugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:42 user nova-compute[73627]: WARNING nova.compute.manager [req-353d4f3a-9418-4a8b-8561-405667ece628 req-f59abe7f-01db-45c6-b666-fd8891560c3a service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received unexpected event network-vif-unplugged-e193c76c-8dac-420e-9749-9c42f62ad3cf for instance with vm_state active and task_state rebuilding.
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lazy-loading 'flavor' on Instance uuid 914c5004-52af-4826-914d-ca3d215cf040 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-859c0fac-c873-4263-8edb-7a3451203651 req-69d100e6-71c2-4f03-bc3d-135bce8adb6b service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-859c0fac-c873-4263-8edb-7a3451203651 req-69d100e6-71c2-4f03-bc3d-135bce8adb6b service nova] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-859c0fac-c873-4263-8edb-7a3451203651 req-69d100e6-71c2-4f03-bc3d-135bce8adb6b service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-859c0fac-c873-4263-8edb-7a3451203651 req-69d100e6-71c2-4f03-bc3d-135bce8adb6b service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG nova.compute.manager [req-859c0fac-c873-4263-8edb-7a3451203651 req-69d100e6-71c2-4f03-bc3d-135bce8adb6b service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] No waiting events found dispatching network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:42 user nova-compute[73627]: WARNING nova.compute.manager [req-859c0fac-c873-4263-8edb-7a3451203651 req-69d100e6-71c2-4f03-bc3d-135bce8adb6b service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received unexpected event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e for instance with vm_state building and task_state spawning.
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:42 user nova-compute[73627]: INFO nova.compute.manager [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Attaching volume 99c76ff5-63f9-4385-9c70-a47b7a26dd92 to /dev/vdc
Aug 26 16:34:42 user nova-compute[73627]: DEBUG os_brick.utils [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e34c58-a3f0-42b4-abff-f414fd99f368]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[617a21db-c8f8-4b6c-b2d2-24ce8968fb79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:42 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067682.9979627, 8e049438-4a89-4bc9-bd98-397c8c699fc9 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:34:42 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] VM Resumed (Lifecycle Event)
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[812b072f-1796-4d72-9518-d7cc93e64021]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2d2dc9-0f6b-4f2d-847d-e69578bf08e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:43 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Instance spawned successfully.
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:34:43 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b19007d-171a-45da-ae73-d799cf5f9dd5]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.utils [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Updating existing volume attachment record: a548ccf1-f7fb-48c2-8696-4d11dd793dea {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:34:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067683.0013583, 8e049438-4a89-4bc9-bd98-397c8c699fc9 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:34:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] VM Started (Lifecycle Event)
Aug 26 16:34:43 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Instance destroyed successfully.
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:34:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:34:43 user nova-compute[73627]: INFO nova.compute.manager [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Took 6.75 seconds to spawn the instance on the hypervisor.
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:43 user nova-compute[73627]: INFO nova.compute.manager [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Detaching volume b0d891e3-b2f1-4638-9e12-cc767d416ac9
Aug 26 16:34:43 user nova-compute[73627]: INFO nova.compute.manager [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Took 7.81 seconds to build instance.
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc9cb04b-e3dd-4346-80f0-8526702aad95 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.919s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:43 user nova-compute[73627]: INFO nova.virt.block_device [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Attempting to driver detach volume b0d891e3-b2f1-4638-9e12-cc767d416ac9 from mountpoint /dev/vdb
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Attempting to detach device vdb from instance b5277d78-3a96-4d79-8825-26d042254c12 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:34:43 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:34:43 user nova-compute[73627]:   <source dev="/dev/sdh"/>
Aug 26 16:34:43 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:34:43 user nova-compute[73627]:   <serial>b0d891e3-b2f1-4638-9e12-cc767d416ac9</serial>
Aug 26 16:34:43 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:34:43 user nova-compute[73627]: </disk>
Aug 26 16:34:43 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:34:43 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully detached device vdb from instance b5277d78-3a96-4d79-8825-26d042254c12 from the persistent domain config.
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYEBtHkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:34:43 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04f563f-a571-472b-8f30-269cdeac70dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2d2bf6-ba5b-42cd-861f-3ff7aad8d539]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:34:43 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:43 user nova-compute[73627]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:34:43 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e83d2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9'): ({'sdh'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Removing single pathed devices sdh {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e27b3b-597d-4623-b02b-38b20e1155e9]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50c265e-0d4c-42ce-920b-69d5db301c8f]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flushing IO for device /dev/sdh {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0030d464-476d-4b21-bd4a-daf5438b13b2]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a31a8c-a915-40a5-b058-9166fed9400b]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] SCSI volumes sdh have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f93e03-ae2a-4aa3-a02f-e77f43bda1cb]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[723af988-6855-4a19-9318-e3d7e66f5c4a]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260]
Aug 26 16:34:43 user nova-compute[73627]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260] successful.
Aug 26 16:34:43 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfd36c7-25f8-4541-8ff8-d79039b91bec]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== disconnect_volume: return (345ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:34:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:44 user nova-compute[73627]: INFO nova.compute.manager [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Terminating instance
Aug 26 16:34:44 user nova-compute[73627]: DEBUG nova.compute.manager [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.volume.cinder [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Update attachment failed for attachment a548ccf1-f7fb-48c2-8696-4d11dd793dea. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:99c76ff5-63f9-4385-9c70-a47b7a26dd92 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 26 16:34:44 user nova-compute[73627]: Collecting current configuration:
Aug 26 16:34:44 user nova-compute[73627]: FATAL: Received the following error:
Aug 26 16:34:44 user nova-compute[73627]:         groups(): Target 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9' is not available
Aug 26 16:34:44 user nova-compute[73627]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:99c76ff5-63f9-4385-9c70-a47b7a26dd92 -driver iscsi -attributes ImmediateData=Yes -noprompt...).). (HTTP 500) (Request-ID: req-caa52b90-584b-4289-a4b5-9e513f3b74ad) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:99c76ff5-63f9-4385-9c70-a47b7a26dd92 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error: 
Aug 26 16:34:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] No waiting events found dispatching network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:44 user nova-compute[73627]: WARNING nova.compute.manager [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received unexpected event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf for instance with vm_state active and task_state rebuilding.
Aug 26 16:34:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-changed-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG nova.compute.manager [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Refreshing instance network info cache due to event network-changed-d43b5527-a43b-4a93-88fb-db830093b5ea. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] Acquiring lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] Acquired lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG nova.network.neutron [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Refreshing network info cache for port d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Failed to attach 99c76ff5-63f9-4385-9c70-a47b7a26dd92 at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:99c76ff5-63f9-4385-9c70-a47b7a26dd92 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 26 16:34:44 user nova-compute[73627]: Collecting current configuration:
Aug 26 16:34:44 user nova-compute[73627]: FATAL: Received the following error:
Aug 26 16:34:44 user nova-compute[73627]:         groups(): Target 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9' is not available
Aug 26 16:34:44 user nova-compute[73627]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:99c76ff5-63f9-4385-9c70-a47b7a26dd92 -driver iscsi -attributes ImmediateData=Yes -noprompt...).). (HTTP 500) (Request-ID: req-caa52b90-584b-4289-a4b5-9e513f3b74ad)
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040] Traceback (most recent call last):
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     ret_val = method(obj, context, *args, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     self._do_attach(context, instance, volume, volume_api,
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     self._volume_attach(context, volume, connector, instance,
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     connection_info = volume_api.attachment_update(
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     res = method(self, ctx, *args, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     with excutils.save_and_reraise_exception():
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     self.force_reraise()
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     raise self.value
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     return method.func(obj, *args, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     resp = self._update('/attachments/%s' % id, body)
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     return self.request(url, method, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]     raise exceptions.from_response(resp, body)
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:99c76ff5-63f9-4385-9c70-a47b7a26dd92 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040] Collecting current configuration:
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040] 
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040] FATAL: Received the following error:
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040] 
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040]         groups(): Target 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9' is not available
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040] 
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040] :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:99c76ff5-63f9-4385-9c70-a47b7a26dd92 -driver iscsi -attributes ImmediateData=Yes -noprompt...).). (HTTP 500) (Request-ID: req-caa52b90-584b-4289-a4b5-9e513f3b74ad)
Aug 26 16:34:44 user nova-compute[73627]: ERROR nova.compute.manager [instance: 914c5004-52af-4826-914d-ca3d215cf040] 
Aug 26 16:34:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 1.960s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server [None req-4c109421-77f7-41b7-9005-78d93e192e03 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:99c76ff5-63f9-4385-9c70-a47b7a26dd92 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 26 16:34:44 user nova-compute[73627]: Collecting current configuration:
Aug 26 16:34:44 user nova-compute[73627]: FATAL: Received the following error:
Aug 26 16:34:44 user nova-compute[73627]:         groups(): Target 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9' is not available
Aug 26 16:34:44 user nova-compute[73627]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:99c76ff5-63f9-4385-9c70-a47b7a26dd92 -driver iscsi -attributes ImmediateData=Yes -noprompt...).). (HTTP 500) (Request-ID: req-caa52b90-584b-4289-a4b5-9e513f3b74ad)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:99c76ff5-63f9-4385-9c70-a47b7a26dd92 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server Collecting current configuration:
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server 
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server FATAL: Received the following error:
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server 
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server         groups(): Target 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9' is not available
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server 
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:99c76ff5-63f9-4385-9c70-a47b7a26dd92 -driver iscsi -attributes ImmediateData=Yes -noprompt...).). (HTTP 500) (Request-ID: req-caa52b90-584b-4289-a4b5-9e513f3b74ad)
Aug 26 16:34:44 user nova-compute[73627]: ERROR oslo_messaging.rpc.server 
Aug 26 16:34:44 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Instance destroyed successfully.
Aug 26 16:34:44 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1120972842',display_name='tempest-ServerActionsTestOtherA-server-870118476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1120972842',id=29,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGEVaZilfejgzOVBO/Dl5oWhwyQx7yT0CQZLwHfV5uQSNiyESnSSBwifVOuHAIiHVCjFzc8FACGrVIdJFbzB7rWnkykjmcwfVvI05Tl83CL/v/O1MgJawrdf1YL0vZThg==',key_name='tempest-keypair-645263688',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:32:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-lbff6ir2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:34:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=b5277d78-3a96-4d79-8825-26d042254c12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG os_vif [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape193c76c-8d, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:34:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:44 user nova-compute[73627]: INFO os_vif [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d')
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYEBtHkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:34:45 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e47c90e-2a2f-4390-ba8f-0240cfed4920]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[427c0f7c-e712-4982-b12f-419e19ca3126]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:45 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:45 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d0240160>, {}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Disconnecting from: [] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== disconnect_volume: return (68ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:34:45 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Deleting instance files /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12_del
Aug 26 16:34:45 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Deletion of /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12_del complete
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-d61e5588-1f84-4783-a035-ff5f99421658 req-64a12c56-f46d-49fd-af19-bc064ccb249d service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-vif-unplugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d61e5588-1f84-4783-a035-ff5f99421658 req-64a12c56-f46d-49fd-af19-bc064ccb249d service nova] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d61e5588-1f84-4783-a035-ff5f99421658 req-64a12c56-f46d-49fd-af19-bc064ccb249d service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d61e5588-1f84-4783-a035-ff5f99421658 req-64a12c56-f46d-49fd-af19-bc064ccb249d service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-d61e5588-1f84-4783-a035-ff5f99421658 req-64a12c56-f46d-49fd-af19-bc064ccb249d service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] No waiting events found dispatching network-vif-unplugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-d61e5588-1f84-4783-a035-ff5f99421658 req-64a12c56-f46d-49fd-af19-bc064ccb249d service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-vif-unplugged-d43b5527-a43b-4a93-88fb-db830093b5ea for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:34:45 user nova-compute[73627]: INFO nova.virt.block_device [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Booting with volume b0d891e3-b2f1-4638-9e12-cc767d416ac9 at /dev/vdb
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.network.neutron [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updated VIF entry in instance network info cache for port d43b5527-a43b-4a93-88fb-db830093b5ea. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.network.neutron [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating instance_info_cache with network_info: [{"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.utils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d429701f-bec7-4104-b6ed-bd45e406a334 req-9ff800f8-bf83-41ee-b195-e4bef20a6d3e service nova] Releasing lock "refresh_cache-02728278-ff6a-41e3-b107-6e3106a56bc4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[638d4c57-9eac-4a7d-bd8b-22341f56cb51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1021b6-b1ca-415f-836a-b6fb20b1d240]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Instance destroyed successfully.
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.objects.instance [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lazy-loading 'resources' on Instance uuid 02728278-ff6a-41e3-b107-6e3106a56bc4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2043883167',display_name='tempest-TestShelveInstance-server-2043883167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2043883167',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUkKnXOk52N39dKNATbuSDCnmPHibOJEXSNpU+Lcz5ewHglXuNqvhgMoqWj5qUG6vl4G0GQ85lQIO6MbKAV4Di+T05lsQA5XzeIA/ENSR9D2OajBzjcbs97FcAoX/6G+w==',key_name='tempest-TestShelveInstance-1574199453',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:33:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cb420f29dc849efa3c0b2d28ab50813',ramdisk_id='',reservation_id='r-uhsml3rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-562411929',owner_user_name='tempest-TestShelveInstance-562411929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:33:14Z,user_data=None,user_id='419538c7a200483689e0e419b34e1489',uuid=02728278-ff6a-41e3-b107-6e3106a56bc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converting VIF {"id": "d43b5527-a43b-4a93-88fb-db830093b5ea", "address": "fa:16:3e:db:2d:8b", "network": {"id": "842d6feb-a9e2-492e-84c0-e7862ed7a5ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1725670033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cb420f29dc849efa3c0b2d28ab50813", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43b5527-a4", "ovs_interfaceid": "d43b5527-a43b-4a93-88fb-db830093b5ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_vif [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f61d72c-0560-4ea4-beac-a48b90f59152]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd43b5527-a4, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b505fb4-466e-475f-9740-bfb11dc4c75a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: INFO os_vif [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2d:8b,bridge_name='br-int',has_traffic_filtering=True,id=d43b5527-a43b-4a93-88fb-db830093b5ea,network=Network(842d6feb-a9e2-492e-84c0-e7862ed7a5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43b5527-a4')
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLTItXHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:34:45 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:34:45 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb230d07-9374-4934-92f8-6a8d2d8b1f2e]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.utils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Updating existing volume attachment record: 1debe746-f044-4dff-b9ff-ba01c4e08d7a {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dcf375-3fec-4fd8-8160-9fe366eb7f8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3179ef6-a077-433d-97f7-740908c072c3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:45 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:45 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:45 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d03e5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837'): ({'sde'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Removing single pathed devices sde {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435ca1f-71f6-4ddc-8d1b-de9785bfa8f9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4133666c-40ce-4067-88cb-f8adea8b7eec]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Flushing IO for device /dev/sde {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d72077-3ee6-4493-b5cb-683ce514ee38]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cede12-1105-4530-9170-0212712fb87d]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea9242d-5f3b-45f2-8595-04db940b0af6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba54540d-6b78-49e9-9c43-4f50348e3e60]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260]
Aug 26 16:34:45 user nova-compute[73627]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837, portal: 172.16.0.220,3260] successful.
Aug 26 16:34:45 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb711b9a-0e3e-4536-bab5-bc7cb6d582e2]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] <== disconnect_volume: return (395ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:34:45 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Deleting instance files /opt/stack/data/nova/instances/02728278-ff6a-41e3-b107-6e3106a56bc4_del
Aug 26 16:34:45 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Deletion of /opt/stack/data/nova/instances/02728278-ff6a-41e3-b107-6e3106a56bc4_del complete
Aug 26 16:34:45 user nova-compute[73627]: INFO nova.compute.manager [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Took 1.43 seconds to destroy the instance on the hypervisor.
Aug 26 16:34:45 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:34:45 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:34:46 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:34:46 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Took 0.54 seconds to deallocate network for instance.
Aug 26 16:34:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-9aa9f8c2-6687-4b32-9f8f-c1373b7bce24 req-cd9e89f0-2c95-423c-ba94-c52cc36086ca service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-vif-deleted-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-b2ce9472-ddb9-4a97-98c0-ce7e0d19cc68 req-73a80438-3a05-4ebe-ad03-668dd8971ba4 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:34:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b2ce9472-ddb9-4a97-98c0-ce7e0d19cc68 req-73a80438-3a05-4ebe-ad03-668dd8971ba4 service nova] Acquiring lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b2ce9472-ddb9-4a97-98c0-ce7e0d19cc68 req-73a80438-3a05-4ebe-ad03-668dd8971ba4 service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b2ce9472-ddb9-4a97-98c0-ce7e0d19cc68 req-73a80438-3a05-4ebe-ad03-668dd8971ba4 service nova] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-b2ce9472-ddb9-4a97-98c0-ce7e0d19cc68 req-73a80438-3a05-4ebe-ad03-668dd8971ba4 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] No waiting events found dispatching network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:34:47 user nova-compute[73627]: WARNING nova.compute.manager [req-b2ce9472-ddb9-4a97-98c0-ce7e0d19cc68 req-73a80438-3a05-4ebe-ad03-668dd8971ba4 service nova] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Received unexpected event network-vif-plugged-d43b5527-a43b-4a93-88fb-db830093b5ea for instance with vm_state active and task_state deleting.
Aug 26 16:34:47 user nova-compute[73627]: INFO nova.compute.manager [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Took 0.76 seconds to detach 1 volumes for instance.
Aug 26 16:34:47 user nova-compute[73627]: DEBUG nova.compute.manager [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Deleting volume: daa1f4a6-a4ad-4b7b-b3a2-fb3f729c7837 {{(pid=73627) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 16:34:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:47 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:34:47 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:34:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:48 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Deleted allocations for instance 02728278-ff6a-41e3-b107-6e3106a56bc4
Aug 26 16:34:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-690b4b08-03ba-4049-8602-1a3199ef45e5 tempest-TestShelveInstance-562411929 tempest-TestShelveInstance-562411929-project-member] Lock "02728278-ff6a-41e3-b107-6e3106a56bc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.579s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:34:57 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Creating image(s)
Aug 26 16:34:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "/opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "/opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk 1073741824" returned: 0 in 0.056s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067683.1241863, b5277d78-3a96-4d79-8825-26d042254c12 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:34:58 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: b5277d78-3a96-4d79-8825-26d042254c12] VM Stopped (Lifecycle Event)
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6dd919ce-71a0-4af4-bdb3-06736c228afc None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Cannot resize image /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Ensure instance console log exists: /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Start _get_guest_xml network_info=[{"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYEBtHkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b5277d78-3a96-4d79-8825-26d042254c12', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0d891e3-b2f1-4638-9e12-cc767d416ac9', 'serial': 'b0d891e3-b2f1-4638-9e12-cc767d416ac9'}, 'guest_format': None, 'attachment_id': '1debe746-f044-4dff-b9ff-ba01c4e08d7a', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:34:58 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 16:34:58 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5277d78-3a96-4d79-8825-26d042254c12 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYEBtHkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:34:58 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:34:58 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:34:58 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a08523d-27b5-4236-8e04-4026fc5f604e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:34:58 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[635aa708-3cf7-4f75-ab79-8fa2a1caa40d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9] added
Aug 26 16:34:58 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2240b496-0c94-4f16-8975-54656f0a52a8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c66052-0bc4-4170-a74b-e3a855e0be2f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYEBtHkp {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYEBtHkp" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[273047a8-0433-4f98-8ca5-94d40cc56038]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gYEBtHkp'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2989a43-c907-44bc-9b08-01814c28e168]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a46661-c86f-4b40-9f8c-1859ea388149]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:58 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:58 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6c9609-824a-45b4-b40e-98048ff5469c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260]
Aug 26 16:34:58 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260] successful.
Aug 26 16:34:58 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[898263c4-ad80-47a0-bf7d-52a543dcc5bc]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9834f8f8-bdbf-42b0-927a-30fc0175c646]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:34:58 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:34:58 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:34:58 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb8b8f9-5e19-4f8f-9392-dcfcff1220d6]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:34:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYEBtHkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23336303635376133', 'path': '/dev/sde'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336303635376133', 'path': '/dev/sde'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1120972842',display_name='tempest-ServerActionsTestOtherA-server-870118476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1120972842',id=29,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGEVaZilfejgzOVBO/Dl5oWhwyQx7yT0CQZLwHfV5uQSNiyESnSSBwifVOuHAIiHVCjFzc8FACGrVIdJFbzB7rWnkykjmcwfVvI05Tl83CL/v/O1MgJawrdf1YL0vZThg==',key_name='tempest-keypair-645263688',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:32:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-lbff6ir2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=b5277d78-3a96-4d79-8825-26d042254c12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:34:59 user nova-compute[73627]:   <uuid>b5277d78-3a96-4d79-8825-26d042254c12</uuid>
Aug 26 16:34:59 user nova-compute[73627]:   <name>instance-0000001d</name>
Aug 26 16:34:59 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:34:59 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:34:59 user nova-compute[73627]:   <metadata>
Aug 26 16:34:59 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:34:59 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:34:59 user nova-compute[73627]:       <nova:name>tempest-ServerActionsTestOtherA-server-870118476</nova:name>
Aug 26 16:34:59 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:34:58</nova:creationTime>
Aug 26 16:34:59 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:34:59 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:34:59 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:34:59 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:34:59 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:34:59 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:34:59 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:34:59 user nova-compute[73627]:       <nova:owner>
Aug 26 16:34:59 user nova-compute[73627]:         <nova:user uuid="8945b1b1110e44568e0de86204d65e34">tempest-ServerActionsTestOtherA-1664197223-project-member</nova:user>
Aug 26 16:34:59 user nova-compute[73627]:         <nova:project uuid="3f8aed25a3184cf884a5774515d6d202">tempest-ServerActionsTestOtherA-1664197223</nova:project>
Aug 26 16:34:59 user nova-compute[73627]:       </nova:owner>
Aug 26 16:34:59 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:34:59 user nova-compute[73627]:       <nova:ports>
Aug 26 16:34:59 user nova-compute[73627]:         <nova:port uuid="e193c76c-8dac-420e-9749-9c42f62ad3cf">
Aug 26 16:34:59 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 16:34:59 user nova-compute[73627]:         </nova:port>
Aug 26 16:34:59 user nova-compute[73627]:       </nova:ports>
Aug 26 16:34:59 user nova-compute[73627]:     </nova:instance>
Aug 26 16:34:59 user nova-compute[73627]:   </metadata>
Aug 26 16:34:59 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:34:59 user nova-compute[73627]:     <system>
Aug 26 16:34:59 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:34:59 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:34:59 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:34:59 user nova-compute[73627]:       <entry name="serial">b5277d78-3a96-4d79-8825-26d042254c12</entry>
Aug 26 16:34:59 user nova-compute[73627]:       <entry name="uuid">b5277d78-3a96-4d79-8825-26d042254c12</entry>
Aug 26 16:34:59 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:34:59 user nova-compute[73627]:     </system>
Aug 26 16:34:59 user nova-compute[73627]:   </sysinfo>
Aug 26 16:34:59 user nova-compute[73627]:   <os>
Aug 26 16:34:59 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:34:59 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:34:59 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:34:59 user nova-compute[73627]:   </os>
Aug 26 16:34:59 user nova-compute[73627]:   <features>
Aug 26 16:34:59 user nova-compute[73627]:     <acpi/>
Aug 26 16:34:59 user nova-compute[73627]:     <apic/>
Aug 26 16:34:59 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:34:59 user nova-compute[73627]:   </features>
Aug 26 16:34:59 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:34:59 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:34:59 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:34:59 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:34:59 user nova-compute[73627]:   </clock>
Aug 26 16:34:59 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:34:59 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:34:59 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:34:59 user nova-compute[73627]:   </cpu>
Aug 26 16:34:59 user nova-compute[73627]:   <devices>
Aug 26 16:34:59 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:34:59 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:34:59 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk"/>
Aug 26 16:34:59 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:34:59 user nova-compute[73627]:     </disk>
Aug 26 16:34:59 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:34:59 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:34:59 user nova-compute[73627]:       <source dev="/dev/sde"/>
Aug 26 16:34:59 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:34:59 user nova-compute[73627]:       <serial>b0d891e3-b2f1-4638-9e12-cc767d416ac9</serial>
Aug 26 16:34:59 user nova-compute[73627]:     </disk>
Aug 26 16:34:59 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:34:59 user nova-compute[73627]:       <mac address="fa:16:3e:cd:6e:eb"/>
Aug 26 16:34:59 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:34:59 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:34:59 user nova-compute[73627]:       <target dev="tape193c76c-8d"/>
Aug 26 16:34:59 user nova-compute[73627]:     </interface>
Aug 26 16:34:59 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:34:59 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/console.log" append="off"/>
Aug 26 16:34:59 user nova-compute[73627]:     </serial>
Aug 26 16:34:59 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:34:59 user nova-compute[73627]:     <video>
Aug 26 16:34:59 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:34:59 user nova-compute[73627]:     </video>
Aug 26 16:34:59 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:34:59 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:34:59 user nova-compute[73627]:     </rng>
Aug 26 16:34:59 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:34:59 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:34:59 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:34:59 user nova-compute[73627]:     </memballoon>
Aug 26 16:34:59 user nova-compute[73627]:   </devices>
Aug 26 16:34:59 user nova-compute[73627]: </domain>
Aug 26 16:34:59 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1120972842',display_name='tempest-ServerActionsTestOtherA-server-870118476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1120972842',id=29,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGEVaZilfejgzOVBO/Dl5oWhwyQx7yT0CQZLwHfV5uQSNiyESnSSBwifVOuHAIiHVCjFzc8FACGrVIdJFbzB7rWnkykjmcwfVvI05Tl83CL/v/O1MgJawrdf1YL0vZThg==',key_name='tempest-keypair-645263688',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:32:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-lbff6ir2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=b5277d78-3a96-4d79-8825-26d042254c12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG os_vif [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape193c76c-8d, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape193c76c-8d, col_values=(('external_ids', {'iface-id': 'e193c76c-8dac-420e-9749-9c42f62ad3cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:6e:eb', 'vm-uuid': 'b5277d78-3a96-4d79-8825-26d042254c12'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:34:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:34:59 user nova-compute[73627]: INFO os_vif [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d')
Aug 26 16:35:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:35:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:35:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No VIF found with MAC fa:16:3e:cd:6e:eb, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:35:00 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067685.3652523, 02728278-ff6a-41e3-b107-6e3106a56bc4 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:35:00 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] VM Stopped (Lifecycle Event)
Aug 26 16:35:00 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b1f23039-dc57-4105-85c6-f31773924016 None None] [instance: 02728278-ff6a-41e3-b107-6e3106a56bc4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-0b910bec-2db6-4b5c-ac85-2fa1ad38d1fb req-70fa22ac-52f7-453c-9d83-3eb6c23764e7 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0b910bec-2db6-4b5c-ac85-2fa1ad38d1fb req-70fa22ac-52f7-453c-9d83-3eb6c23764e7 service nova] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0b910bec-2db6-4b5c-ac85-2fa1ad38d1fb req-70fa22ac-52f7-453c-9d83-3eb6c23764e7 service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0b910bec-2db6-4b5c-ac85-2fa1ad38d1fb req-70fa22ac-52f7-453c-9d83-3eb6c23764e7 service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-0b910bec-2db6-4b5c-ac85-2fa1ad38d1fb req-70fa22ac-52f7-453c-9d83-3eb6c23764e7 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] No waiting events found dispatching network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:01 user nova-compute[73627]: WARNING nova.compute.manager [req-0b910bec-2db6-4b5c-ac85-2fa1ad38d1fb req-70fa22ac-52f7-453c-9d83-3eb6c23764e7 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received unexpected event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf for instance with vm_state active and task_state rebuild_spawning.
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067703.5114174, b5277d78-3a96-4d79-8825-26d042254c12 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:35:03 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] VM Resumed (Lifecycle Event)
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:35:03 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Instance spawned successfully.
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:35:03 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067703.516007, b5277d78-3a96-4d79-8825-26d042254c12 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:35:03 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] VM Started (Lifecycle Event)
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:03 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.compute.manager [req-d7370248-bfe1-40e1-b987-29238ab17724 req-7f77eb6e-5f5e-4ec6-929c-81f4a9e62c89 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d7370248-bfe1-40e1-b987-29238ab17724 req-7f77eb6e-5f5e-4ec6-929c-81f4a9e62c89 service nova] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d7370248-bfe1-40e1-b987-29238ab17724 req-7f77eb6e-5f5e-4ec6-929c-81f4a9e62c89 service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d7370248-bfe1-40e1-b987-29238ab17724 req-7f77eb6e-5f5e-4ec6-929c-81f4a9e62c89 service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.compute.manager [req-d7370248-bfe1-40e1-b987-29238ab17724 req-7f77eb6e-5f5e-4ec6-929c-81f4a9e62c89 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] No waiting events found dispatching network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:03 user nova-compute[73627]: WARNING nova.compute.manager [req-d7370248-bfe1-40e1-b987-29238ab17724 req-7f77eb6e-5f5e-4ec6-929c-81f4a9e62c89 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received unexpected event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf for instance with vm_state active and task_state rebuild_spawning.
Aug 26 16:35:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73627) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 16:35:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b401be4c-5b9f-4d60-9416-97805f8d033e tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.079s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:05 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:35:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:05 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:35:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:35:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:35:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:12 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:35:12 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=6516MB free_disk=24.975082397460938GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a20c0a68-9781-4d6c-8f55-6952f1758f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19c82f60-3294-4a09-96a3-b03a1673149c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance daca1645-10d4-45e7-874a-b2972a494e6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 914c5004-52af-4826-914d-ca3d215cf040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b5277d78-3a96-4d79-8825-26d042254c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b1f798a4-a09c-4a10-ba68-650b7c757f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f9416f88-5192-4ffd-ae4b-1a521913d824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8e049438-4a89-4bc9-bd98-397c8c699fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:35:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=14GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:35:13 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:35:13 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:35:13 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:35:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-a20c0a68-9781-4d6c-8f55-6952f1758f1f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-a20c0a68-9781-4d6c-8f55-6952f1758f1f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:35:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Updating instance_info_cache with network_info: [{"id": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "address": "fa:16:3e:fa:cd:15", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d678db-6b", "ovs_interfaceid": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:35:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-a20c0a68-9781-4d6c-8f55-6952f1758f1f" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:35:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:35:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:35:16 user nova-compute[73627]: INFO nova.compute.manager [None req-e778df7e-a1a1-4f93-82e2-bbabd4908b50 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Unrescuing
Aug 26 16:35:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e778df7e-a1a1-4f93-82e2-bbabd4908b50 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:35:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e778df7e-a1a1-4f93-82e2-bbabd4908b50 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquired lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:35:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e778df7e-a1a1-4f93-82e2-bbabd4908b50 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e778df7e-a1a1-4f93-82e2-bbabd4908b50 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updating instance_info_cache with network_info: [{"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e778df7e-a1a1-4f93-82e2-bbabd4908b50 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Releasing lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e778df7e-a1a1-4f93-82e2-bbabd4908b50 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'flavor' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-b6135b1c-50fb-497a-a890-4eebd219b172 req-e2641f42-e21b-4c9e-9006-24e7feba1313 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-unplugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6135b1c-50fb-497a-a890-4eebd219b172 req-e2641f42-e21b-4c9e-9006-24e7feba1313 service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6135b1c-50fb-497a-a890-4eebd219b172 req-e2641f42-e21b-4c9e-9006-24e7feba1313 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b6135b1c-50fb-497a-a890-4eebd219b172 req-e2641f42-e21b-4c9e-9006-24e7feba1313 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-b6135b1c-50fb-497a-a890-4eebd219b172 req-e2641f42-e21b-4c9e-9006-24e7feba1313 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-unplugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:17 user nova-compute[73627]: WARNING nova.compute.manager [req-b6135b1c-50fb-497a-a890-4eebd219b172 req-e2641f42-e21b-4c9e-9006-24e7feba1313 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received unexpected event network-vif-unplugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:35:18 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Instance destroyed successfully.
Aug 26 16:35:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:18 user nova-compute[73627]: INFO nova.compute.manager [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Terminating instance
Aug 26 16:35:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:35:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-967bd85f-1f10-47be-b719-aad32a131bb8 req-5a82cb76-bea2-40cd-971d-d9b0e198e3fc service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-unplugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-967bd85f-1f10-47be-b719-aad32a131bb8 req-5a82cb76-bea2-40cd-971d-d9b0e198e3fc service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-967bd85f-1f10-47be-b719-aad32a131bb8 req-5a82cb76-bea2-40cd-971d-d9b0e198e3fc service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-967bd85f-1f10-47be-b719-aad32a131bb8 req-5a82cb76-bea2-40cd-971d-d9b0e198e3fc service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-967bd85f-1f10-47be-b719-aad32a131bb8 req-5a82cb76-bea2-40cd-971d-d9b0e198e3fc service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-unplugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-967bd85f-1f10-47be-b719-aad32a131bb8 req-5a82cb76-bea2-40cd-971d-d9b0e198e3fc service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-unplugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:19 user nova-compute[73627]: WARNING nova.compute.manager [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received unexpected event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:35:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-changed-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Refreshing instance network info cache due to event network-changed-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Acquiring lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Acquired lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG nova.network.neutron [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Refreshing network info cache for port 02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:35:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Instance destroyed successfully.
Aug 26 16:35:20 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'resources' on Instance uuid b1f798a4-a09c-4a10-ba68-650b7c757f7f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1313029250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1313029250',id=20,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Ve2IfJyqHfgM4j2Ukkn/LY683coRDCPGAAsz9e3ka/78aNiOeL/f3py3hYvGD8aA2KH2Z1BxUGJunxaaylIFIDdalkdbYI5hNec0W5iTvxkkLsdG3rIuOXZNIqtmbwg==',key_name='tempest-keypair-1653270261',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:33:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-8sdto70b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:33:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=b1f798a4-a09c-4a10-ba68-650b7c757f7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "address": "fa:16:3e:10:da:20", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc0dfcd-a7", "ovs_interfaceid": "acc0dfcd-a792-461b-890b-47ad7a7ca1e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG os_vif [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacc0dfcd-a7, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:35:20 user nova-compute[73627]: INFO os_vif [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:da:20,bridge_name='br-int',has_traffic_filtering=True,id=acc0dfcd-a792-461b-890b-47ad7a7ca1e4,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc0dfcd-a7')
Aug 26 16:35:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Deleting instance files /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f_del
Aug 26 16:35:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Deletion of /opt/stack/data/nova/instances/b1f798a4-a09c-4a10-ba68-650b7c757f7f_del complete
Aug 26 16:35:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:20 user nova-compute[73627]: INFO nova.compute.manager [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Took 1.46 seconds to destroy the instance on the hypervisor.
Aug 26 16:35:20 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updated VIF entry in instance network info cache for port 02c1f98d-e7ae-4afb-a56a-35cf0b0050ff. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updating instance_info_cache with network_info: [{"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Releasing lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-changed-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Refreshing instance network info cache due to event network-changed-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Acquiring lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Acquired lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Refreshing network info cache for port 02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:35:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updated VIF entry in instance network info cache for port 02c1f98d-e7ae-4afb-a56a-35cf0b0050ff. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updating instance_info_cache with network_info: [{"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Releasing lock "refresh_cache-d77a7aa1-4027-4036-b8e5-60f7fd05dfff" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:21 user nova-compute[73627]: WARNING nova.compute.manager [req-c4cdb595-e064-42c0-a36d-59f8f8b1b461 req-37d94bc7-c7e0-4928-8e0b-5e573c464588 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received unexpected event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:21 user nova-compute[73627]: WARNING nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received unexpected event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with vm_state active and task_state deleting.
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:21 user nova-compute[73627]: WARNING nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received unexpected event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with vm_state active and task_state deleting.
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:21 user nova-compute[73627]: WARNING nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received unexpected event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with vm_state active and task_state deleting.
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-unplugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-unplugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-unplugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Acquiring lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] No waiting events found dispatching network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:21 user nova-compute[73627]: WARNING nova.compute.manager [req-79e2b6fb-bea0-4956-b83c-64d54d137fda req-39daf075-aac5-4a04-a5ae-6b53b875f798 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received unexpected event network-vif-plugged-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 for instance with vm_state active and task_state deleting.
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:35:21 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Took 1.26 seconds to deallocate network for instance.
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:21 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Deleted allocations for instance b1f798a4-a09c-4a10-ba68-650b7c757f7f
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-40770939-6fc7-4d5f-bb93-a843bbdba4e1 req-c59221ef-3933-4672-aca6-2fa98eaa8383 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-40770939-6fc7-4d5f-bb93-a843bbdba4e1 req-c59221ef-3933-4672-aca6-2fa98eaa8383 service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-40770939-6fc7-4d5f-bb93-a843bbdba4e1 req-c59221ef-3933-4672-aca6-2fa98eaa8383 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-40770939-6fc7-4d5f-bb93-a843bbdba4e1 req-c59221ef-3933-4672-aca6-2fa98eaa8383 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-40770939-6fc7-4d5f-bb93-a843bbdba4e1 req-c59221ef-3933-4672-aca6-2fa98eaa8383 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:21 user nova-compute[73627]: WARNING nova.compute.manager [req-40770939-6fc7-4d5f-bb93-a843bbdba4e1 req-c59221ef-3933-4672-aca6-2fa98eaa8383 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received unexpected event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:35:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-40770939-6fc7-4d5f-bb93-a843bbdba4e1 req-c59221ef-3933-4672-aca6-2fa98eaa8383 service nova] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Received event network-vif-deleted-acc0dfcd-a792-461b-890b-47ad7a7ca1e4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e7fa4f0-9d92-4422-87a3-becb98756bf8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "b1f798a4-a09c-4a10-ba68-650b7c757f7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.377s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Removed pending event for d77a7aa1-4027-4036-b8e5-60f7fd05dfff due to event {{(pid=73627) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 16:35:22 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067722.1247694, d77a7aa1-4027-4036-b8e5-60f7fd05dfff => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:35:22 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] VM Resumed (Lifecycle Event)
Aug 26 16:35:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e778df7e-a1a1-4f93-82e2-bbabd4908b50 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:35:22 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 16:35:22 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067722.1259959, d77a7aa1-4027-4036-b8e5-60f7fd05dfff => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:35:22 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] VM Started (Lifecycle Event)
Aug 26 16:35:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:35:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:34 user nova-compute[73627]: INFO nova.compute.manager [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Terminating instance
Aug 26 16:35:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-6e083f90-349f-4320-856a-b00c1db96331 req-cc226bde-6cb8-4156-9a86-8c14d67a765f service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-unplugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6e083f90-349f-4320-856a-b00c1db96331 req-cc226bde-6cb8-4156-9a86-8c14d67a765f service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6e083f90-349f-4320-856a-b00c1db96331 req-cc226bde-6cb8-4156-9a86-8c14d67a765f service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6e083f90-349f-4320-856a-b00c1db96331 req-cc226bde-6cb8-4156-9a86-8c14d67a765f service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-6e083f90-349f-4320-856a-b00c1db96331 req-cc226bde-6cb8-4156-9a86-8c14d67a765f service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-unplugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-6e083f90-349f-4320-856a-b00c1db96331 req-cc226bde-6cb8-4156-9a86-8c14d67a765f service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-unplugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067720.0264564, b1f798a4-a09c-4a10-ba68-650b7c757f7f => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:35:35 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] VM Stopped (Lifecycle Event)
Aug 26 16:35:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-3557cdaf-d9ed-48ee-a270-162b6898aa97 None None] [instance: b1f798a4-a09c-4a10-ba68-650b7c757f7f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:35 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Instance destroyed successfully.
Aug 26 16:35:35 user nova-compute[73627]: DEBUG nova.objects.instance [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'resources' on Instance uuid 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-450066436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-450066436',id=25,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:32:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8b8b30c15b8423e90156082111b000f',ramdisk_id='',reservation_id='r-7s3q8pbq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:33:48Z,user_data=None,user_id='f24169ea97724e1288631ea977a068bd',uuid=995309d1-3ec1-4ded-a2b5-5c359d2f3f48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converting VIF {"id": "7252e98b-6ee2-4b47-a339-16612b95c731", "address": "fa:16:3e:c5:9b:20", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7252e98b-6e", "ovs_interfaceid": "7252e98b-6ee2-4b47-a339-16612b95c731", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:9b:20,bridge_name='br-int',has_traffic_filtering=True,id=7252e98b-6ee2-4b47-a339-16612b95c731,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7252e98b-6e') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_vif [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:9b:20,bridge_name='br-int',has_traffic_filtering=True,id=7252e98b-6ee2-4b47-a339-16612b95c731,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7252e98b-6e') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7252e98b-6e, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:35 user nova-compute[73627]: INFO os_vif [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:9b:20,bridge_name='br-int',has_traffic_filtering=True,id=7252e98b-6ee2-4b47-a339-16612b95c731,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7252e98b-6e')
Aug 26 16:35:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skaSoEfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:35:35 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faa9818-b497-471e-b86a-b2d8624be227]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace1cfd6-faee-42cd-bb14-2eac8e87b14f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:35:35 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:35:35 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:35:35 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:35:35 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:35:35 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:35:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 (non-flash)
Aug 26 16:35:35 user nova-compute[73627]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:35:35 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:35:35 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:35:35 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:35:35 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:35:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3f6fa13f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4'): ({'sdd'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Removing single pathed devices sdd {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4066da9c-1ae1-41d5-92b4-19ba7bcdfd41]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed8b46a-b522-4fe4-ae56-dbac364b2958]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Flushing IO for device /dev/sdd {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[51515585-d43d-405e-9497-c585f1e5333e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba15dd73-cf20-4052-aeda-9052def79e7b]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a14fbc-4c5c-4c27-aec2-511016105936]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02b26c3-d879-44bd-9525-c3c618d9ba9d]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4, portal: 172.16.0.220,3260]
Aug 26 16:35:35 user nova-compute[73627]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4, portal: 172.16.0.220,3260] successful.
Aug 26 16:35:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9cc9eda-fe1f-4a0f-8acc-60befcfc17f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aadc86d-a7d7-4f6f-8904-13860add4681]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] <== disconnect_volume: return (316ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:35:35 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Deleting instance files /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48_del
Aug 26 16:35:35 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Deletion of /opt/stack/data/nova/instances/995309d1-3ec1-4ded-a2b5-5c359d2f3f48_del complete
Aug 26 16:35:35 user nova-compute[73627]: INFO nova.compute.manager [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 26 16:35:35 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:35:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-fcc583ea-85b0-4453-9d80-dd56743d5375 req-6195a0f0-5182-48ff-8c55-23143d562665 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fcc583ea-85b0-4453-9d80-dd56743d5375 req-6195a0f0-5182-48ff-8c55-23143d562665 service nova] Acquiring lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fcc583ea-85b0-4453-9d80-dd56743d5375 req-6195a0f0-5182-48ff-8c55-23143d562665 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fcc583ea-85b0-4453-9d80-dd56743d5375 req-6195a0f0-5182-48ff-8c55-23143d562665 service nova] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-fcc583ea-85b0-4453-9d80-dd56743d5375 req-6195a0f0-5182-48ff-8c55-23143d562665 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] No waiting events found dispatching network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:36 user nova-compute[73627]: WARNING nova.compute.manager [req-fcc583ea-85b0-4453-9d80-dd56743d5375 req-6195a0f0-5182-48ff-8c55-23143d562665 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received unexpected event network-vif-plugged-7252e98b-6ee2-4b47-a339-16612b95c731 for instance with vm_state active and task_state deleting.
Aug 26 16:35:36 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:35:36 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Took 1.25 seconds to deallocate network for instance.
Aug 26 16:35:37 user nova-compute[73627]: INFO nova.compute.manager [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Took 0.88 seconds to detach 1 volumes for instance.
Aug 26 16:35:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:38 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:35:38 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:35:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:38 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Deleted allocations for instance 995309d1-3ec1-4ded-a2b5-5c359d2f3f48
Aug 26 16:35:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a8288203-d7fc-46b4-81d9-36dd6b858276 tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "995309d1-3ec1-4ded-a2b5-5c359d2f3f48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.980s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-3da77de2-c697-45ce-87b6-37a4e31658e4 req-b1bfb752-7044-4ce6-b812-954e031b9337 service nova] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Received event network-vif-deleted-7252e98b-6ee2-4b47-a339-16612b95c731 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:46 user nova-compute[73627]: INFO nova.compute.manager [None req-eaef118c-2109-4092-a702-eb1bb11c900a tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Unrescuing
Aug 26 16:35:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-eaef118c-2109-4092-a702-eb1bb11c900a tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:35:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-eaef118c-2109-4092-a702-eb1bb11c900a tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquired lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:35:46 user nova-compute[73627]: DEBUG nova.network.neutron [None req-eaef118c-2109-4092-a702-eb1bb11c900a tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:35:47 user nova-compute[73627]: DEBUG nova.network.neutron [None req-eaef118c-2109-4092-a702-eb1bb11c900a tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updating instance_info_cache with network_info: [{"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:35:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-eaef118c-2109-4092-a702-eb1bb11c900a tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Releasing lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:35:47 user nova-compute[73627]: DEBUG nova.objects.instance [None req-eaef118c-2109-4092-a702-eb1bb11c900a tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'flavor' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:35:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-4cb0326b-e1e1-42f7-adbd-1d8ce05d5b34 req-fd91996e-65a4-4839-a0a6-0608f7b053ed service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-unplugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4cb0326b-e1e1-42f7-adbd-1d8ce05d5b34 req-fd91996e-65a4-4839-a0a6-0608f7b053ed service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4cb0326b-e1e1-42f7-adbd-1d8ce05d5b34 req-fd91996e-65a4-4839-a0a6-0608f7b053ed service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4cb0326b-e1e1-42f7-adbd-1d8ce05d5b34 req-fd91996e-65a4-4839-a0a6-0608f7b053ed service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:47 user nova-compute[73627]: DEBUG nova.compute.manager [req-4cb0326b-e1e1-42f7-adbd-1d8ce05d5b34 req-fd91996e-65a4-4839-a0a6-0608f7b053ed service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-unplugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:47 user nova-compute[73627]: WARNING nova.compute.manager [req-4cb0326b-e1e1-42f7-adbd-1d8ce05d5b34 req-fd91996e-65a4-4839-a0a6-0608f7b053ed service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received unexpected event network-vif-unplugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:35:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:47 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Instance destroyed successfully.
Aug 26 16:35:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:49 user nova-compute[73627]: WARNING nova.compute.manager [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received unexpected event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:35:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:49 user nova-compute[73627]: WARNING nova.compute.manager [req-5de0f4d1-9fa2-466a-99d9-b4ec051f18ee req-ec82f769-1522-4166-bc5b-46b55574eafc service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received unexpected event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with vm_state rescued and task_state unrescuing.
Aug 26 16:35:50 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067735.2211041, 995309d1-3ec1-4ded-a2b5-5c359d2f3f48 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:35:50 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] VM Stopped (Lifecycle Event)
Aug 26 16:35:50 user nova-compute[73627]: DEBUG nova.compute.manager [None req-2895435d-eee2-4684-84dd-96e66f0456c3 None None] [instance: 995309d1-3ec1-4ded-a2b5-5c359d2f3f48] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:50 user nova-compute[73627]: INFO nova.compute.manager [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Detaching volume 713cffac-3d2b-41b3-8ac4-1b4203ec022e
Aug 26 16:35:50 user nova-compute[73627]: INFO nova.virt.block_device [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Attempting to driver detach volume 713cffac-3d2b-41b3-8ac4-1b4203ec022e from mountpoint /dev/vdb
Aug 26 16:35:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Attempting to detach device vdb from instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:35:50 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:35:50 user nova-compute[73627]:   <source dev="/dev/sdf"/>
Aug 26 16:35:50 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:35:50 user nova-compute[73627]:   <serial>713cffac-3d2b-41b3-8ac4-1b4203ec022e</serial>
Aug 26 16:35:50 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:35:50 user nova-compute[73627]: </disk>
Aug 26 16:35:50 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:35:50 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Successfully detached device vdb from instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff from the persistent domain config.
Aug 26 16:35:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:35:50 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:35:50 user nova-compute[73627]:   <source dev="/dev/sdf"/>
Aug 26 16:35:50 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:35:50 user nova-compute[73627]:   <serial>713cffac-3d2b-41b3-8ac4-1b4203ec022e</serial>
Aug 26 16:35:50 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:35:50 user nova-compute[73627]: </disk>
Aug 26 16:35:50 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067750.875201, d77a7aa1-4027-4036-b8e5-60f7fd05dfff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:35:50 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Successfully detached device vdb from instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff from the live domain config.
Aug 26 16:35:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSRMkrGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:35:50 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:35:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2205e56-d6a8-4540-a34d-dcd3ee69f1fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12975f8-bd6f-40df-acf4-08cebb13b39d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:35:50 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:35:50 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:35:50 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:35:50 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:35:50 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e (non-flash)
Aug 26 16:35:50 user nova-compute[73627]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:35:50 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:35:50 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:35:50 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:35:50 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e8359870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e'): ({'sdf'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Removing single pathed devices sdf {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12eea27-3dec-413c-a20e-176dba2ae5ba]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c598a82-c342-44c1-9c53-da513d803293]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Flushing IO for device /dev/sdf {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:35:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d2a010-ce9c-4827-8535-e6d30fa875c5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[48878af6-d628-454f-9a59-7108e2892861]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] SCSI volumes sdf have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c0947f-faa5-41a8-baee-2f58afe5beba]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b16822-7182-494d-b038-c87f841aa4af]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e, portal: 172.16.0.220,3260]
Aug 26 16:35:51 user nova-compute[73627]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e, portal: 172.16.0.220,3260] successful.
Aug 26 16:35:51 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713cffac-3d2b-41b3-8ac4-1b4203ec022e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c76726f-dead-4c08-b187-c6fe30d5b8b6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] <== disconnect_volume: return (295ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Removed pending event for daca1645-10d4-45e7-874a-b2972a494e6e due to event {{(pid=73627) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067751.1843064, daca1645-10d4-45e7-874a-b2972a494e6e => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:35:51 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] VM Resumed (Lifecycle Event)
Aug 26 16:35:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-eaef118c-2109-4092-a702-eb1bb11c900a tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:35:51 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 16:35:51 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067751.1867304, daca1645-10d4-45e7-874a-b2972a494e6e => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:35:51 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] VM Started (Lifecycle Event)
Aug 26 16:35:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-6d7cc494-82a9-4d43-9d3f-4c516e9afa7f req-74656fec-34be-4be4-bb7c-a9b677a9659e service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6d7cc494-82a9-4d43-9d3f-4c516e9afa7f req-74656fec-34be-4be4-bb7c-a9b677a9659e service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6d7cc494-82a9-4d43-9d3f-4c516e9afa7f req-74656fec-34be-4be4-bb7c-a9b677a9659e service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6d7cc494-82a9-4d43-9d3f-4c516e9afa7f req-74656fec-34be-4be4-bb7c-a9b677a9659e service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-6d7cc494-82a9-4d43-9d3f-4c516e9afa7f req-74656fec-34be-4be4-bb7c-a9b677a9659e service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:35:51 user nova-compute[73627]: WARNING nova.compute.manager [req-6d7cc494-82a9-4d43-9d3f-4c516e9afa7f req-74656fec-34be-4be4-bb7c-a9b677a9659e service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received unexpected event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with vm_state active and task_state None.
Aug 26 16:35:52 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'flavor' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:35:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b6faaaf3-6fd5-4ea0-89d3-56017b18ddc3 tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.746s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:35:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:36:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:36:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:36:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:36:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:05 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:36:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:05 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:36:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:36:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:36:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-8d912ad7-df66-4d1f-8247-fffe7ac6c153 req-ed7a9f90-7004-42c4-b70b-141f11234878 service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Received event network-changed-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-8d912ad7-df66-4d1f-8247-fffe7ac6c153 req-ed7a9f90-7004-42c4-b70b-141f11234878 service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Refreshing instance network info cache due to event network-changed-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8d912ad7-df66-4d1f-8247-fffe7ac6c153 req-ed7a9f90-7004-42c4-b70b-141f11234878 service nova] Acquiring lock "refresh_cache-f9416f88-5192-4ffd-ae4b-1a521913d824" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8d912ad7-df66-4d1f-8247-fffe7ac6c153 req-ed7a9f90-7004-42c4-b70b-141f11234878 service nova] Acquired lock "refresh_cache-f9416f88-5192-4ffd-ae4b-1a521913d824" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG nova.network.neutron [req-8d912ad7-df66-4d1f-8247-fffe7ac6c153 req-ed7a9f90-7004-42c4-b70b-141f11234878 service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Refreshing network info cache for port 036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-8d912ad7-df66-4d1f-8247-fffe7ac6c153 req-ed7a9f90-7004-42c4-b70b-141f11234878 service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Updated VIF entry in instance network info cache for port 036e9d53-5a7f-4d85-834b-0c4d4fdc7f31. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-8d912ad7-df66-4d1f-8247-fffe7ac6c153 req-ed7a9f90-7004-42c4-b70b-141f11234878 service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Updating instance_info_cache with network_info: [{"id": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "address": "fa:16:3e:d9:c1:91", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036e9d53-5a", "ovs_interfaceid": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8d912ad7-df66-4d1f-8247-fffe7ac6c153 req-ed7a9f90-7004-42c4-b70b-141f11234878 service nova] Releasing lock "refresh_cache-f9416f88-5192-4ffd-ae4b-1a521913d824" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:11 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:36:11 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:36:11 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=6690MB free_disk=24.964191436767578GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:36:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a20c0a68-9781-4d6c-8f55-6952f1758f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 19c82f60-3294-4a09-96a3-b03a1673149c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance daca1645-10d4-45e7-874a-b2972a494e6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 914c5004-52af-4826-914d-ca3d215cf040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b5277d78-3a96-4d79-8825-26d042254c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f9416f88-5192-4ffd-ae4b-1a521913d824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8e049438-4a89-4bc9-bd98-397c8c699fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:36:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "98114285-9c1d-4ff4-9121-77bd1a798200" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:36:13 user nova-compute[73627]: INFO nova.compute.claims [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Claim successful on node user
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f9416f88-5192-4ffd-ae4b-1a521913d824" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.objects.instance [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'flavor' on Instance uuid f9416f88-5192-4ffd-ae4b-1a521913d824 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:36:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:36:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Creating image(s)
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "/opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "/opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "/opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG nova.policy [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c01a881f130f4cbe9c70e2acd4842b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93acb667ea194ce4b6f55e4e86fe9f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f9416f88-5192-4ffd-ae4b-1a521913d824" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:13 user nova-compute[73627]: INFO nova.compute.manager [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Attaching volume e6f49258-564f-4381-b5ad-5fb10788134f to /dev/vdb
Aug 26 16:36:14 user nova-compute[73627]: DEBUG os_brick.utils [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f4cbce-2a97-45d5-b57e-7d831d6f4679]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[24807983-c1a4-401f-99a4-a17ed72c0afc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb237b3-fff5-4a54-863c-eb6b5db6ae92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dcec89-ec13-4d62-b2be-f7f8aeec6061]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:36:14 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[755e8f3a-a5e0-4b58-85aa-7b1f9151f63c]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG os_brick.utils [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Updating existing volume attachment record: f1c9b583-2625-41c2-80e0-e6d4359f60c0 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.193s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk 1073741824" returned: 0 in 0.052s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Cannot resize image /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Ensure instance console log exists: /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:14 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Successfully created port: 8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Successfully updated port: 8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquired lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG nova.compute.manager [req-50f59def-6edb-4316-ac0a-8be4bd96b392 req-a4b3350e-b274-45a6-9cd0-6dc30380ce94 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-changed-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG nova.compute.manager [req-50f59def-6edb-4316-ac0a-8be4bd96b392 req-a4b3350e-b274-45a6-9cd0-6dc30380ce94 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Refreshing instance network info cache due to event network-changed-8437f747-1797-4480-9ad4-52e88581f6c1. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-50f59def-6edb-4316-ac0a-8be4bd96b392 req-a4b3350e-b274-45a6-9cd0-6dc30380ce94 service nova] Acquiring lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updating instance_info_cache with network_info: [{"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Releasing lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Instance network_info: |[{"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-50f59def-6edb-4316-ac0a-8be4bd96b392 req-a4b3350e-b274-45a6-9cd0-6dc30380ce94 service nova] Acquired lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.network.neutron [req-50f59def-6edb-4316-ac0a-8be4bd96b392 req-a4b3350e-b274-45a6-9cd0-6dc30380ce94 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Refreshing network info cache for port 8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Start _get_guest_xml network_info=[{"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:36:16 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:36:16 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-233452645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-233452645',id=32,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0ddVKlODQpyHh4KT4LZnVXn94T1Lwdm0PnrfafPY1hWmK4SZJYuJRT2e+F5UcAOCxUPzvz/BqVEYfiayi4QRZCRWncJwCoDfzYVAWf8qI/e1XQvBI3Fbb4ZetPPf9gWA==',key_name='tempest-keypair-9464290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-ln08v5k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=98114285-9c1d-4ff4-9121-77bd1a798200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.objects.instance [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'pci_devices' on Instance uuid 98114285-9c1d-4ff4-9121-77bd1a798200 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:36:16 user nova-compute[73627]:   <uuid>98114285-9c1d-4ff4-9121-77bd1a798200</uuid>
Aug 26 16:36:16 user nova-compute[73627]:   <name>instance-00000020</name>
Aug 26 16:36:16 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:36:16 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:36:16 user nova-compute[73627]:   <metadata>
Aug 26 16:36:16 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:36:16 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:36:16 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-233452645</nova:name>
Aug 26 16:36:16 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:36:16</nova:creationTime>
Aug 26 16:36:16 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:36:16 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:36:16 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:36:16 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:36:16 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:36:16 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:36:16 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:36:16 user nova-compute[73627]:       <nova:owner>
Aug 26 16:36:16 user nova-compute[73627]:         <nova:user uuid="c01a881f130f4cbe9c70e2acd4842b8d">tempest-AttachVolumeShelveTestJSON-2118968964-project-member</nova:user>
Aug 26 16:36:16 user nova-compute[73627]:         <nova:project uuid="93acb667ea194ce4b6f55e4e86fe9f5c">tempest-AttachVolumeShelveTestJSON-2118968964</nova:project>
Aug 26 16:36:16 user nova-compute[73627]:       </nova:owner>
Aug 26 16:36:16 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:36:16 user nova-compute[73627]:       <nova:ports>
Aug 26 16:36:16 user nova-compute[73627]:         <nova:port uuid="8437f747-1797-4480-9ad4-52e88581f6c1">
Aug 26 16:36:16 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 16:36:16 user nova-compute[73627]:         </nova:port>
Aug 26 16:36:16 user nova-compute[73627]:       </nova:ports>
Aug 26 16:36:16 user nova-compute[73627]:     </nova:instance>
Aug 26 16:36:16 user nova-compute[73627]:   </metadata>
Aug 26 16:36:16 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:36:16 user nova-compute[73627]:     <system>
Aug 26 16:36:16 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:36:16 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:36:16 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:36:16 user nova-compute[73627]:       <entry name="serial">98114285-9c1d-4ff4-9121-77bd1a798200</entry>
Aug 26 16:36:16 user nova-compute[73627]:       <entry name="uuid">98114285-9c1d-4ff4-9121-77bd1a798200</entry>
Aug 26 16:36:16 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:36:16 user nova-compute[73627]:     </system>
Aug 26 16:36:16 user nova-compute[73627]:   </sysinfo>
Aug 26 16:36:16 user nova-compute[73627]:   <os>
Aug 26 16:36:16 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:36:16 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:36:16 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:36:16 user nova-compute[73627]:   </os>
Aug 26 16:36:16 user nova-compute[73627]:   <features>
Aug 26 16:36:16 user nova-compute[73627]:     <acpi/>
Aug 26 16:36:16 user nova-compute[73627]:     <apic/>
Aug 26 16:36:16 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:36:16 user nova-compute[73627]:   </features>
Aug 26 16:36:16 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:36:16 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:36:16 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:36:16 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:36:16 user nova-compute[73627]:   </clock>
Aug 26 16:36:16 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:36:16 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:36:16 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:36:16 user nova-compute[73627]:   </cpu>
Aug 26 16:36:16 user nova-compute[73627]:   <devices>
Aug 26 16:36:16 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:36:16 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:36:16 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk"/>
Aug 26 16:36:16 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:36:16 user nova-compute[73627]:     </disk>
Aug 26 16:36:16 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:36:16 user nova-compute[73627]:       <mac address="fa:16:3e:a0:1d:97"/>
Aug 26 16:36:16 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:36:16 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:36:16 user nova-compute[73627]:       <target dev="tap8437f747-17"/>
Aug 26 16:36:16 user nova-compute[73627]:     </interface>
Aug 26 16:36:16 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:36:16 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/console.log" append="off"/>
Aug 26 16:36:16 user nova-compute[73627]:     </serial>
Aug 26 16:36:16 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:36:16 user nova-compute[73627]:     <video>
Aug 26 16:36:16 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:36:16 user nova-compute[73627]:     </video>
Aug 26 16:36:16 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:36:16 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:36:16 user nova-compute[73627]:     </rng>
Aug 26 16:36:16 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:36:16 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:36:16 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:36:16 user nova-compute[73627]:     </memballoon>
Aug 26 16:36:16 user nova-compute[73627]:   </devices>
Aug 26 16:36:16 user nova-compute[73627]: </domain>
Aug 26 16:36:16 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-233452645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-233452645',id=32,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0ddVKlODQpyHh4KT4LZnVXn94T1Lwdm0PnrfafPY1hWmK4SZJYuJRT2e+F5UcAOCxUPzvz/BqVEYfiayi4QRZCRWncJwCoDfzYVAWf8qI/e1XQvBI3Fbb4ZetPPf9gWA==',key_name='tempest-keypair-9464290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-ln08v5k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=98114285-9c1d-4ff4-9121-77bd1a798200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG os_vif [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8437f747-17, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8437f747-17, col_values=(('external_ids', {'iface-id': '8437f747-1797-4480-9ad4-52e88581f6c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:1d:97', 'vm-uuid': '98114285-9c1d-4ff4-9121-77bd1a798200'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:16 user nova-compute[73627]: INFO os_vif [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17')
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] No VIF found with MAC fa:16:3e:a0:1d:97, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.network.neutron [req-50f59def-6edb-4316-ac0a-8be4bd96b392 req-a4b3350e-b274-45a6-9cd0-6dc30380ce94 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updated VIF entry in instance network info cache for port 8437f747-1797-4480-9ad4-52e88581f6c1. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.network.neutron [req-50f59def-6edb-4316-ac0a-8be4bd96b392 req-a4b3350e-b274-45a6-9cd0-6dc30380ce94 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updating instance_info_cache with network_info: [{"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-50f59def-6edb-4316-ac0a-8be4bd96b392 req-a4b3350e-b274-45a6-9cd0-6dc30380ce94 service nova] Releasing lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:36:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:36:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:17 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating instance_info_cache with network_info: [{"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:36:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-19c82f60-3294-4a09-96a3-b03a1673149c" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:36:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:36:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-9c6ac9f3-2062-47aa-a74a-a17d9f9d30b6 req-e21b6c94-77ab-4aae-ae75-36d665200f69 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9c6ac9f3-2062-47aa-a74a-a17d9f9d30b6 req-e21b6c94-77ab-4aae-ae75-36d665200f69 service nova] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9c6ac9f3-2062-47aa-a74a-a17d9f9d30b6 req-e21b6c94-77ab-4aae-ae75-36d665200f69 service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9c6ac9f3-2062-47aa-a74a-a17d9f9d30b6 req-e21b6c94-77ab-4aae-ae75-36d665200f69 service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-9c6ac9f3-2062-47aa-a74a-a17d9f9d30b6 req-e21b6c94-77ab-4aae-ae75-36d665200f69 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] No waiting events found dispatching network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:36:17 user nova-compute[73627]: WARNING nova.compute.manager [req-9c6ac9f3-2062-47aa-a74a-a17d9f9d30b6 req-e21b6c94-77ab-4aae-ae75-36d665200f69 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received unexpected event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 for instance with vm_state building and task_state spawning.
Aug 26 16:36:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:19 user nova-compute[73627]: INFO nova.compute.manager [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Terminating instance
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-79c4d25d-ce11-42fc-8da8-a6e2982962e9 req-d8ec274b-836b-4694-a5bb-fe9132f35d24 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79c4d25d-ce11-42fc-8da8-a6e2982962e9 req-d8ec274b-836b-4694-a5bb-fe9132f35d24 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79c4d25d-ce11-42fc-8da8-a6e2982962e9 req-d8ec274b-836b-4694-a5bb-fe9132f35d24 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-79c4d25d-ce11-42fc-8da8-a6e2982962e9 req-d8ec274b-836b-4694-a5bb-fe9132f35d24 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-79c4d25d-ce11-42fc-8da8-a6e2982962e9 req-d8ec274b-836b-4694-a5bb-fe9132f35d24 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-79c4d25d-ce11-42fc-8da8-a6e2982962e9 req-d8ec274b-836b-4694-a5bb-fe9132f35d24 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-unplugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:36:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Instance destroyed successfully.
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.objects.instance [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'resources' on Instance uuid 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067779.8733628, 98114285-9c1d-4ff4-9121-77bd1a798200 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:36:19 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] VM Resumed (Lifecycle Event)
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1917134968',display_name='tempest-AttachVolumeTestJSON-server-1917134968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1917134968',id=16,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmPyc6b8C0t21vVKkIWZ8TNBX7zHUhspQfWwTTrOQhl3lcjdUwR4/NQ46CDlwG3vnNcoZ8dr3nq8LPGrMhj+EHJbbjv6sYh5dC2wyhw9PPy0yzES0uh+NmbTaehI0g66w==',key_name='tempest-keypair-1635152815',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0x3g7upm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=903e3d2f-fd02-4a36-8b02-dba90b33b8f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "address": "fa:16:3e:d1:9a:8b", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfd70b91-61", "ovs_interfaceid": "cfd70b91-61a4-4ad8-9354-412fb74106c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG os_vif [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfd70b91-61, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:36:19 user nova-compute[73627]: INFO os_vif [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9a:8b,bridge_name='br-int',has_traffic_filtering=True,id=cfd70b91-61a4-4ad8-9354-412fb74106c1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfd70b91-61')
Aug 26 16:36:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Deleting instance files /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3_del
Aug 26 16:36:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Deletion of /opt/stack/data/nova/instances/903e3d2f-fd02-4a36-8b02-dba90b33b8f3_del complete
Aug 26 16:36:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Instance spawned successfully.
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:36:19 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067779.8745594, 98114285-9c1d-4ff4-9121-77bd1a798200 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:36:19 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] VM Started (Lifecycle Event)
Aug 26 16:36:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:36:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:36:20 user nova-compute[73627]: INFO nova.compute.manager [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 26 16:36:20 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:36:20 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:36:20 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:36:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-0d1205f8-2b41-45d8-8d06-e8ca0cb40896 req-de4bb4ef-da2c-440e-aa7e-65031b947fbd service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0d1205f8-2b41-45d8-8d06-e8ca0cb40896 req-de4bb4ef-da2c-440e-aa7e-65031b947fbd service nova] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0d1205f8-2b41-45d8-8d06-e8ca0cb40896 req-de4bb4ef-da2c-440e-aa7e-65031b947fbd service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0d1205f8-2b41-45d8-8d06-e8ca0cb40896 req-de4bb4ef-da2c-440e-aa7e-65031b947fbd service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-0d1205f8-2b41-45d8-8d06-e8ca0cb40896 req-de4bb4ef-da2c-440e-aa7e-65031b947fbd service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] No waiting events found dispatching network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:36:20 user nova-compute[73627]: WARNING nova.compute.manager [req-0d1205f8-2b41-45d8-8d06-e8ca0cb40896 req-de4bb4ef-da2c-440e-aa7e-65031b947fbd service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received unexpected event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 for instance with vm_state building and task_state spawning.
Aug 26 16:36:20 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:36:20 user nova-compute[73627]: INFO nova.compute.manager [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Took 6.20 seconds to spawn the instance on the hypervisor.
Aug 26 16:36:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:36:20 user nova-compute[73627]: INFO nova.compute.manager [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Took 7.04 seconds to build instance.
Aug 26 16:36:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5b5d606b-cc25-4cce-8a16-0c063f948d1b tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "98114285-9c1d-4ff4-9121-77bd1a798200" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.149s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:21 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:36:21 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Took 1.00 seconds to deallocate network for instance.
Aug 26 16:36:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:21 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:36:21 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:36:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:21 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Deleted allocations for instance 903e3d2f-fd02-4a36-8b02-dba90b33b8f3
Aug 26 16:36:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc014613-52b8-4af0-8881-9841fd7dff89 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.392s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-5ae83ed2-aa19-4a82-8d69-3683046620e4 req-79903727-78d3-443c-b9d3-92b70609d8c7 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5ae83ed2-aa19-4a82-8d69-3683046620e4 req-79903727-78d3-443c-b9d3-92b70609d8c7 service nova] Acquiring lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5ae83ed2-aa19-4a82-8d69-3683046620e4 req-79903727-78d3-443c-b9d3-92b70609d8c7 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5ae83ed2-aa19-4a82-8d69-3683046620e4 req-79903727-78d3-443c-b9d3-92b70609d8c7 service nova] Lock "903e3d2f-fd02-4a36-8b02-dba90b33b8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-5ae83ed2-aa19-4a82-8d69-3683046620e4 req-79903727-78d3-443c-b9d3-92b70609d8c7 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] No waiting events found dispatching network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:36:21 user nova-compute[73627]: WARNING nova.compute.manager [req-5ae83ed2-aa19-4a82-8d69-3683046620e4 req-79903727-78d3-443c-b9d3-92b70609d8c7 service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received unexpected event network-vif-plugged-cfd70b91-61a4-4ad8-9354-412fb74106c1 for instance with vm_state deleted and task_state None.
Aug 26 16:36:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-f3bd79a9-3baa-4fc1-a142-eff8bc48d90d req-204b9b0f-a2fc-4891-a7e7-0d9c9df626fd service nova] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Received event network-vif-deleted-cfd70b91-61a4-4ad8-9354-412fb74106c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:25 user nova-compute[73627]: INFO nova.compute.manager [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Terminating instance
Aug 26 16:36:25 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-1b0e91c0-b786-4d8f-a1bc-5109b1bd7a76 req-2fce7ef6-bd10-4232-a54a-31ee743544f8 service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Received event network-vif-unplugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1b0e91c0-b786-4d8f-a1bc-5109b1bd7a76 req-2fce7ef6-bd10-4232-a54a-31ee743544f8 service nova] Acquiring lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1b0e91c0-b786-4d8f-a1bc-5109b1bd7a76 req-2fce7ef6-bd10-4232-a54a-31ee743544f8 service nova] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1b0e91c0-b786-4d8f-a1bc-5109b1bd7a76 req-2fce7ef6-bd10-4232-a54a-31ee743544f8 service nova] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-1b0e91c0-b786-4d8f-a1bc-5109b1bd7a76 req-2fce7ef6-bd10-4232-a54a-31ee743544f8 service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] No waiting events found dispatching network-vif-unplugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:36:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-1b0e91c0-b786-4d8f-a1bc-5109b1bd7a76 req-2fce7ef6-bd10-4232-a54a-31ee743544f8 service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Received event network-vif-unplugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Instance destroyed successfully.
Aug 26 16:36:26 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'resources' on Instance uuid a20c0a68-9781-4d6c-8f55-6952f1758f1f {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-76647444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-76647444',id=17,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:27:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8b8b30c15b8423e90156082111b000f',ramdisk_id='',reservation_id='r-sj6kr4d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:29:00Z,user_data=None,user_id='f24169ea97724e1288631ea977a068bd',uuid=a20c0a68-9781-4d6c-8f55-6952f1758f1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "address": "fa:16:3e:fa:cd:15", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d678db-6b", "ovs_interfaceid": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converting VIF {"id": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "address": "fa:16:3e:fa:cd:15", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d678db-6b", "ovs_interfaceid": "59d678db-6b22-4bb3-a3a1-d8661d59e588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=59d678db-6b22-4bb3-a3a1-d8661d59e588,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d678db-6b') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_vif [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=59d678db-6b22-4bb3-a3a1-d8661d59e588,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d678db-6b') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59d678db-6b, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:36:26 user nova-compute[73627]: INFO os_vif [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=59d678db-6b22-4bb3-a3a1-d8661d59e588,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d678db-6b')
Aug 26 16:36:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Deleting instance files /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f_del
Aug 26 16:36:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Deletion of /opt/stack/data/nova/instances/a20c0a68-9781-4d6c-8f55-6952f1758f1f_del complete
Aug 26 16:36:26 user nova-compute[73627]: INFO nova.compute.manager [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArHkvCcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:36:26 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:36:26 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:36:26 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[243e25d2-6678-45ff-a23c-be0e6a80a420]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:36:26 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8724f988-c5f1-4f28-bf77-df8931d4092d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f] added
Aug 26 16:36:26 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6ae5ab-b29b-4bf0-9c69-6815ef6ea2ba]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[326f8646-3bd1-406c-9a84-e6082b88d263]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ArHkvCcd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-66ae48a1-a3f2-4b5f-bb1c-0220205bddb7 req-bece2388-ae4d-4c53-995c-a57368c9e84b service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Received event network-vif-deleted-59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:26 user nova-compute[73627]: INFO nova.compute.manager [req-66ae48a1-a3f2-4b5f-bb1c-0220205bddb7 req-bece2388-ae4d-4c53-995c-a57368c9e84b service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Neutron deleted interface 59d678db-6b22-4bb3-a3a1-d8661d59e588; detaching it from the instance and deleting it from the info cache
Aug 26 16:36:26 user nova-compute[73627]: DEBUG nova.network.neutron [req-66ae48a1-a3f2-4b5f-bb1c-0220205bddb7 req-bece2388-ae4d-4c53-995c-a57368c9e84b service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:36:26 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Took 0.65 seconds to deallocate network for instance.
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ArHkvCcd" returned: 0 in 0.037s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea389323-e7ea-43c9-814a-4774daa36243]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ArHkvCcd'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-66ae48a1-a3f2-4b5f-bb1c-0220205bddb7 req-bece2388-ae4d-4c53-995c-a57368c9e84b service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Detach interface failed, port_id=59d678db-6b22-4bb3-a3a1-d8661d59e588, reason: Instance a20c0a68-9781-4d6c-8f55-6952f1758f1f could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[843339be-1c34-49fd-b8a6-e297345ca6bb]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68f24fb-5f5a-46be-a8d6-56f5e16e3c5a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:26 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:36:26 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:26 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:26 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:26 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:36:26 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:26 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:26 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[66454b43-8369-426f-aa94-6a91aa6d9598]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f, portal: 172.16.0.220,3260]
Aug 26 16:36:27 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f, portal: 172.16.0.220,3260] successful.
Aug 26 16:36:27 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f314b17-3178-4565-a4b4-5b965c87b544]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff62593-7849-4df6-a9da-271779d549b5]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:27 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:36:27 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:27 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:27 user nova-compute[73627]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f (non-flash)
Aug 26 16:36:27 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:27 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:36:27 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:27 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:27 user nova-compute[73627]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f (non-flash)
Aug 26 16:36:27 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.051s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bccc4b-aabe-4887-a1ff-f4dc565b98e5]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArHkvCcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:27 user nova-compute[73627]: INFO nova.compute.manager [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Terminating instance
Aug 26 16:36:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:27 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Deleted allocations for instance a20c0a68-9781-4d6c-8f55-6952f1758f1f
Aug 26 16:36:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b9ae1f43-b42d-4f26-bee8-674f64d78a8d tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.471s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-72220b55-b0ef-4735-abb7-9a335f52d3e3 req-6a3af69a-7966-4497-a625-ed446a7fe1de service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Received event network-vif-plugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-72220b55-b0ef-4735-abb7-9a335f52d3e3 req-6a3af69a-7966-4497-a625-ed446a7fe1de service nova] Acquiring lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-72220b55-b0ef-4735-abb7-9a335f52d3e3 req-6a3af69a-7966-4497-a625-ed446a7fe1de service nova] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-72220b55-b0ef-4735-abb7-9a335f52d3e3 req-6a3af69a-7966-4497-a625-ed446a7fe1de service nova] Lock "a20c0a68-9781-4d6c-8f55-6952f1758f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-72220b55-b0ef-4735-abb7-9a335f52d3e3 req-6a3af69a-7966-4497-a625-ed446a7fe1de service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] No waiting events found dispatching network-vif-plugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:36:28 user nova-compute[73627]: WARNING nova.compute.manager [req-72220b55-b0ef-4735-abb7-9a335f52d3e3 req-6a3af69a-7966-4497-a625-ed446a7fe1de service nova] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Received unexpected event network-vif-plugged-59d678db-6b22-4bb3-a3a1-d8661d59e588 for instance with vm_state deleted and task_state None.
Aug 26 16:36:28 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Instance destroyed successfully.
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.objects.instance [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lazy-loading 'resources' on Instance uuid 19c82f60-3294-4a09-96a3-b03a1673149c {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1150395174',display_name='tempest-ServerActionsTestOtherB-server-1150395174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1150395174',id=19,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsMLcp+BUGxkTU5eO6A9fURs5JKJUKrz971vfnvzmwjrONPq4qpNUgYZ+CzdRhMT1bKtdKKOR19LocoMu/yIF+ku4vNBbvF97/+zoHaRx1dCCz3qB4DhdvvVw1Om3Llw==',key_name='tempest-keypair-646039968',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:33:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc034dfcf2a3437b9b505fc54cd014a6',ramdisk_id='',reservation_id='r-c0b38pf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1300226985',owner_user_name='tempest-ServerActionsTestOtherB-1300226985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d633720332174fe9a29c1b7775698982',uuid=19c82f60-3294-4a09-96a3-b03a1673149c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converting VIF {"id": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "address": "fa:16:3e:4a:53:d2", "network": {"id": "f639642b-0d9d-4444-af21-ca7621dffb96", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-337726789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc034dfcf2a3437b9b505fc54cd014a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae911fbe-6a", "ovs_interfaceid": "ae911fbe-6ac5-4ef1-8224-47806a42627b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_vif [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae911fbe-6a, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:36:28 user nova-compute[73627]: INFO os_vif [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:53:d2,bridge_name='br-int',has_traffic_filtering=True,id=ae911fbe-6ac5-4ef1-8224-47806a42627b,network=Network(f639642b-0d9d-4444-af21-ca7621dffb96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae911fbe-6a')
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfRpZHCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:36:28 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23661366639653736', 'path': '/dev/sdd'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661366639653736', 'path': '/dev/sdd'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.034s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.objects.instance [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'flavor' on Instance uuid f9416f88-5192-4ffd-ae4b-1a521913d824 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c055be55-8292-45a4-acdc-2bc8dd51e7c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:36:28 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:36:28 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:36:28 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:36:28 user nova-compute[73627]:   <serial>e6f49258-564f-4381-b5ad-5fb10788134f</serial>
Aug 26 16:36:28 user nova-compute[73627]: </disk>
Aug 26 16:36:28 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a525de83-870e-4099-b298-ce4728ef071f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:28 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:36:28 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:28 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:28 user nova-compute[73627]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f (non-flash)
Aug 26 16:36:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:28 user nova-compute[73627]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 (non-flash)
Aug 26 16:36:28 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:28 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:28 user nova-compute[73627]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f (non-flash)
Aug 26 16:36:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3ac723640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9'): ({'sdg'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Removing single pathed devices sdg {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[32403b26-08ec-4c37-8197-f79c0c6dc701]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cda9fe-dcc0-42f1-a497-d11b04b039b6]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Flushing IO for device /dev/sdg {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f873c83-cdbe-4c31-9c9c-cbefca0c66da]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fad76d-c8e0-4fdd-8ac5-8335668e24a8]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] SCSI volumes sdg have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d75cde0-f1ad-4464-bf91-34df496aa068]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc2b05f-194e-4ca0-b147-29f63c862807]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260]
Aug 26 16:36:28 user nova-compute[73627]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9, portal: 172.16.0.220,3260] successful.
Aug 26 16:36:28 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddd40a9-9db0-4b60-b9a1-ed534dac70a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ff45ee-2e30-4447-ac6f-d63d11ac73b6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] <== disconnect_volume: return (335ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:36:28 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Deleting instance files /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c_del
Aug 26 16:36:28 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Deletion of /opt/stack/data/nova/instances/19c82f60-3294-4a09-96a3-b03a1673149c_del complete
Aug 26 16:36:28 user nova-compute[73627]: INFO nova.compute.manager [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Took 1.41 seconds to destroy the instance on the hypervisor.
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] No VIF found with MAC fa:16:3e:d9:c1:91, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-65625b7b-64eb-409c-9727-626cb69c52f1 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.959s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-unplugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-unplugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-unplugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] Acquiring lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] Lock "19c82f60-3294-4a09-96a3-b03a1673149c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] No waiting events found dispatching network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:36:28 user nova-compute[73627]: WARNING nova.compute.manager [req-201084c8-c1a7-4dc5-8780-0719acaafe22 req-80a0b0f8-fc8d-497f-b425-f11d093d2075 service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received unexpected event network-vif-plugged-ae911fbe-6ac5-4ef1-8224-47806a42627b for instance with vm_state active and task_state deleting.
Aug 26 16:36:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f9416f88-5192-4ffd-ae4b-1a521913d824" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:29 user nova-compute[73627]: INFO nova.compute.manager [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Detaching volume e6f49258-564f-4381-b5ad-5fb10788134f
Aug 26 16:36:29 user nova-compute[73627]: INFO nova.virt.block_device [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Attempting to driver detach volume e6f49258-564f-4381-b5ad-5fb10788134f from mountpoint /dev/vdb
Aug 26 16:36:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Attempting to detach device vdb from instance f9416f88-5192-4ffd-ae4b-1a521913d824 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:36:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:36:29 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:36:29 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:36:29 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:36:29 user nova-compute[73627]:   <serial>e6f49258-564f-4381-b5ad-5fb10788134f</serial>
Aug 26 16:36:29 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:36:29 user nova-compute[73627]: </disk>
Aug 26 16:36:29 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:36:29 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully detached device vdb from instance f9416f88-5192-4ffd-ae4b-1a521913d824 from the persistent domain config.
Aug 26 16:36:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9416f88-5192-4ffd-ae4b-1a521913d824 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:36:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:36:29 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:36:29 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:36:29 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:36:29 user nova-compute[73627]:   <serial>e6f49258-564f-4381-b5ad-5fb10788134f</serial>
Aug 26 16:36:29 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:36:29 user nova-compute[73627]: </disk>
Aug 26 16:36:29 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:36:29 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:36:29 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Took 1.21 seconds to deallocate network for instance.
Aug 26 16:36:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067790.2372828, f9416f88-5192-4ffd-ae4b-1a521913d824 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9416f88-5192-4ffd-ae4b-1a521913d824 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:36:30 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully detached device vdb from instance f9416f88-5192-4ffd-ae4b-1a521913d824 from the live domain config.
Aug 26 16:36:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArHkvCcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:36:30 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5140df-10db-45e0-beb9-6ffc621c9054]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[127276e2-935e-4b93-be38-a09512880153]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:30 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:30 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:30 user nova-compute[73627]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f (non-flash)
Aug 26 16:36:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:30 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:30 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:30 user nova-compute[73627]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f (non-flash)
Aug 26 16:36:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d04b12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f'): ({'sdd'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Removing single pathed devices sdd {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[093e5f3d-86da-4554-9b6e-c1b4a7601c00]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b25173-d171-49bd-a151-bcdc82a454bc]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Flushing IO for device /dev/sdd {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b92a92-a138-4107-b9db-546a7953f297]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95c516f-6f0f-4956-a4de-7de59b8812a5]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f24de2-defd-4345-95fe-61d220f1677a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[04372a1f-015b-4b70-bbf4-42af75a5c94c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f, portal: 172.16.0.220,3260]
Aug 26 16:36:30 user nova-compute[73627]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f, portal: 172.16.0.220,3260] successful.
Aug 26 16:36:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f49258-564f-4381-b5ad-5fb10788134f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7554f3-13f6-4bcd-b8e5-d0fdb4fcc5e6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] <== disconnect_volume: return (326ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:36:30 user nova-compute[73627]: INFO nova.compute.manager [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Took 0.89 seconds to detach 1 volumes for instance.
Aug 26 16:36:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-7c030464-abff-40cf-8235-2c8bb0c584de req-2ebb976e-2c7d-4d4e-9b76-91caf399999d service nova] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Received event network-vif-deleted-ae911fbe-6ac5-4ef1-8224-47806a42627b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:31 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Deleted allocations for instance 19c82f60-3294-4a09-96a3-b03a1673149c
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1df5e738-bb0a-43b1-ba50-697450d79f9d tempest-ServerActionsTestOtherB-1300226985 tempest-ServerActionsTestOtherB-1300226985-project-member] Lock "19c82f60-3294-4a09-96a3-b03a1673149c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.239s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'flavor' on Instance uuid f9416f88-5192-4ffd-ae4b-1a521913d824 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e997c30a-cfdd-4e25-8849-cde8c9e8d418 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.945s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'flavor' on Instance uuid 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:31 user nova-compute[73627]: INFO nova.compute.manager [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Attaching volume 363ef156-d623-44d4-a815-6526e108a262 to /dev/vdb
Aug 26 16:36:31 user nova-compute[73627]: DEBUG os_brick.utils [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8816ce-0a0c-47f0-a5a5-468d13c2ef26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6485a3e-6781-4f44-aa01-b8053c0d7775]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c3d0b5-e940-4445-9ee2-82d0db2c8a25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bae1582-bade-45e9-99f1-d8623153172a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:36:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:36:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:36:32 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:36:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[566dd24f-b550-47e1-8839-1a15faf2fb3d]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:36:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:36:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:36:32 user nova-compute[73627]: DEBUG os_brick.utils [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:36:32 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updating existing volume attachment record: 6ec51e5e-a02f-4a0e-bcbd-eb1ed2d0afd8 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:36:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:34 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067779.854632, 903e3d2f-fd02-4a36-8b02-dba90b33b8f3 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:36:34 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] VM Stopped (Lifecycle Event)
Aug 26 16:36:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-57548b07-1c59-40a3-8469-5f14dcbd35a5 None None] [instance: 903e3d2f-fd02-4a36-8b02-dba90b33b8f3] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:36:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067786.0831234, a20c0a68-9781-4d6c-8f55-6952f1758f1f => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:36:41 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] VM Stopped (Lifecycle Event)
Aug 26 16:36:41 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9e8b5758-3807-4858-8850-03765547718d None None] [instance: a20c0a68-9781-4d6c-8f55-6952f1758f1f] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:41 user nova-compute[73627]: INFO nova.compute.manager [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Terminating instance
Aug 26 16:36:41 user nova-compute[73627]: DEBUG nova.compute.manager [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-796365d2-005d-4dfd-b671-3775dec0ef28 req-8b18b917-5d56-4f3d-80dc-880cb4742406 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-unplugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-796365d2-005d-4dfd-b671-3775dec0ef28 req-8b18b917-5d56-4f3d-80dc-880cb4742406 service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-796365d2-005d-4dfd-b671-3775dec0ef28 req-8b18b917-5d56-4f3d-80dc-880cb4742406 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-796365d2-005d-4dfd-b671-3775dec0ef28 req-8b18b917-5d56-4f3d-80dc-880cb4742406 service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-796365d2-005d-4dfd-b671-3775dec0ef28 req-8b18b917-5d56-4f3d-80dc-880cb4742406 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-unplugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-796365d2-005d-4dfd-b671-3775dec0ef28 req-8b18b917-5d56-4f3d-80dc-880cb4742406 service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-unplugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:36:41 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Instance destroyed successfully.
Aug 26 16:36:41 user nova-compute[73627]: DEBUG nova.objects.instance [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lazy-loading 'resources' on Instance uuid d77a7aa1-4027-4036-b8e5-60f7fd05dfff {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-39161320',display_name='tempest-ServerStableDeviceRescueTest-server-39161320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-39161320',id=23,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO64A3VuwOomVkMVVsLTAzcYE+ExmMEOo9bHneMgJKTrq9rsIIPhjn8kTeqDyPM4piz3MvWbnzDNLC6HZ6tFcdoM9wWYM8egwAGKQgjLwwTX7rRZor9Hr+bqZiVwfpWGkQ==',key_name='tempest-keypair-937707165',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:33:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='170fc5b72aa94714abaa09b77791cae4',ramdisk_id='',reservation_id='r-szbnyb4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1226654466',owner_user_name='tempest-ServerStableDeviceRescueTest-1226654466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:35:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39741061f0a042a98ab5157d648683a4',uuid=d77a7aa1-4027-4036-b8e5-60f7fd05dfff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Converting VIF {"id": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "address": "fa:16:3e:65:3a:12", "network": {"id": "d70def36-9f98-47bf-b769-2fc4dc16fe4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1810865066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "170fc5b72aa94714abaa09b77791cae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c1f98d-e7", "ovs_interfaceid": "02c1f98d-e7ae-4afb-a56a-35cf0b0050ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=02c1f98d-e7ae-4afb-a56a-35cf0b0050ff,network=Network(d70def36-9f98-47bf-b769-2fc4dc16fe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c1f98d-e7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG os_vif [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=02c1f98d-e7ae-4afb-a56a-35cf0b0050ff,network=Network(d70def36-9f98-47bf-b769-2fc4dc16fe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c1f98d-e7') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02c1f98d-e7, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:36:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:36:42 user nova-compute[73627]: INFO os_vif [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=02c1f98d-e7ae-4afb-a56a-35cf0b0050ff,network=Network(d70def36-9f98-47bf-b769-2fc4dc16fe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c1f98d-e7')
Aug 26 16:36:42 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Deleting instance files /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff_del
Aug 26 16:36:42 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Deletion of /opt/stack/data/nova/instances/d77a7aa1-4027-4036-b8e5-60f7fd05dfff_del complete
Aug 26 16:36:42 user nova-compute[73627]: INFO nova.compute.manager [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 16:36:42 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:36:42 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:36:42 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:36:43 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Took 0.98 seconds to deallocate network for instance.
Aug 26 16:36:43 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067788.0909734, 19c82f60-3294-4a09-96a3-b03a1673149c => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:36:43 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] VM Stopped (Lifecycle Event)
Aug 26 16:36:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-55459654-a1cb-4aad-b50e-6187572bf714 None None] [instance: 19c82f60-3294-4a09-96a3-b03a1673149c] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:43 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Deleted allocations for instance d77a7aa1-4027-4036-b8e5-60f7fd05dfff
Aug 26 16:36:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-6f89c4da-65ca-4ba4-9858-78e13958372b req-f0af0d2e-dc6b-4923-96f6-81e704e84ead service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6f89c4da-65ca-4ba4-9858-78e13958372b req-f0af0d2e-dc6b-4923-96f6-81e704e84ead service nova] Acquiring lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6f89c4da-65ca-4ba4-9858-78e13958372b req-f0af0d2e-dc6b-4923-96f6-81e704e84ead service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6f89c4da-65ca-4ba4-9858-78e13958372b req-f0af0d2e-dc6b-4923-96f6-81e704e84ead service nova] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-6f89c4da-65ca-4ba4-9858-78e13958372b req-f0af0d2e-dc6b-4923-96f6-81e704e84ead service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] No waiting events found dispatching network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:36:43 user nova-compute[73627]: WARNING nova.compute.manager [req-6f89c4da-65ca-4ba4-9858-78e13958372b req-f0af0d2e-dc6b-4923-96f6-81e704e84ead service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received unexpected event network-vif-plugged-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff for instance with vm_state deleted and task_state None.
Aug 26 16:36:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-6f89c4da-65ca-4ba4-9858-78e13958372b req-f0af0d2e-dc6b-4923-96f6-81e704e84ead service nova] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Received event network-vif-deleted-02c1f98d-e7ae-4afb-a56a-35cf0b0050ff {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-28f2d321-59b9-4716-b88d-c5e28abeab2b tempest-ServerStableDeviceRescueTest-1226654466 tempest-ServerStableDeviceRescueTest-1226654466-project-member] Lock "d77a7aa1-4027-4036-b8e5-60f7fd05dfff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJUNMurS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:36:43 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:36:43 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:36:43 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2374dea2-7c53-470d-8b5c-fc8c5c3c69d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:36:43 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d185bf63-c1a9-45cb-92f3-9ace280a104f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262] added
Aug 26 16:36:43 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b2525b-a9cd-4e96-a60a-34b9457871d2]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fa633b-8404-4253-9b57-91c64647c8ae]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dJUNMurS {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dJUNMurS" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fcad6b-1aa3-49dd-b986-d768b4c26521]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dJUNMurS'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c04410-a766-4cac-a1ed-35eaafb76120]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f826df49-273d-4df9-a00b-07a349920b3e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:43 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:43 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:43 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:43 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:43 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:43 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[774a5d5b-6bd5-4299-9cac-279f871afea9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260]
Aug 26 16:36:43 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260] successful.
Aug 26 16:36:43 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[def59468-7b55-4e10-8c20-1c33dd177505]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4689959-83ff-4650-8fa0-553569941a26]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:43 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:43 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:43 user nova-compute[73627]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:36:43 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:36:43 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:36:43 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:36:43 user nova-compute[73627]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:36:43 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:36:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:36:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:36:44 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ab201d-5640-4d69-8974-57e50ed2bdaf]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:36:44 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJUNMurS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23263636235643861', 'path': '/dev/sdd'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263636235643861', 'path': '/dev/sdd'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'flavor' on Instance uuid 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:36:45 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:36:45 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:36:45 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:36:45 user nova-compute[73627]:   <serial>363ef156-d623-44d4-a815-6526e108a262</serial>
Aug 26 16:36:45 user nova-compute[73627]: </disk>
Aug 26 16:36:45 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] No VIF found with MAC fa:16:3e:6e:27:2c, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e1787ab2-15c0-469f-a5c1-2f0a4efc6755 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.745s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:36:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:36:56 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067801.9675965, d77a7aa1-4027-4036-b8e5-60f7fd05dfff => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:36:56 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] VM Stopped (Lifecycle Event)
Aug 26 16:36:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-dde5c87d-afa6-4ca3-b900-4da10f98c041 None None] [instance: d77a7aa1-4027-4036-b8e5-60f7fd05dfff] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:36:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:36:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-fe691f26-a894-409d-9533-dfaa96cc1e72 req-6280cb16-a571-4613-8d47-0161e2869279 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-changed-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:36:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-fe691f26-a894-409d-9533-dfaa96cc1e72 req-6280cb16-a571-4613-8d47-0161e2869279 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Refreshing instance network info cache due to event network-changed-9f3a452b-b466-40bd-809e-38d61cd3ba5e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:36:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fe691f26-a894-409d-9533-dfaa96cc1e72 req-6280cb16-a571-4613-8d47-0161e2869279 service nova] Acquiring lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:36:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fe691f26-a894-409d-9533-dfaa96cc1e72 req-6280cb16-a571-4613-8d47-0161e2869279 service nova] Acquired lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:36:57 user nova-compute[73627]: DEBUG nova.network.neutron [req-fe691f26-a894-409d-9533-dfaa96cc1e72 req-6280cb16-a571-4613-8d47-0161e2869279 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Refreshing network info cache for port 9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:36:58 user nova-compute[73627]: DEBUG nova.network.neutron [req-fe691f26-a894-409d-9533-dfaa96cc1e72 req-6280cb16-a571-4613-8d47-0161e2869279 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updated VIF entry in instance network info cache for port 9f3a452b-b466-40bd-809e-38d61cd3ba5e. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:36:58 user nova-compute[73627]: DEBUG nova.network.neutron [req-fe691f26-a894-409d-9533-dfaa96cc1e72 req-6280cb16-a571-4613-8d47-0161e2869279 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updating instance_info_cache with network_info: [{"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:36:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fe691f26-a894-409d-9533-dfaa96cc1e72 req-6280cb16-a571-4613-8d47-0161e2869279 service nova] Releasing lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:37:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-bf70c2d5-182a-466c-95fa-48b33f06fe90 req-59ceda5a-6712-4961-a2a4-4a9672235cea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-changed-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-bf70c2d5-182a-466c-95fa-48b33f06fe90 req-59ceda5a-6712-4961-a2a4-4a9672235cea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Refreshing instance network info cache due to event network-changed-9f3a452b-b466-40bd-809e-38d61cd3ba5e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:37:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bf70c2d5-182a-466c-95fa-48b33f06fe90 req-59ceda5a-6712-4961-a2a4-4a9672235cea service nova] Acquiring lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:37:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bf70c2d5-182a-466c-95fa-48b33f06fe90 req-59ceda5a-6712-4961-a2a4-4a9672235cea service nova] Acquired lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:37:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-bf70c2d5-182a-466c-95fa-48b33f06fe90 req-59ceda5a-6712-4961-a2a4-4a9672235cea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Refreshing network info cache for port 9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:37:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-bf70c2d5-182a-466c-95fa-48b33f06fe90 req-59ceda5a-6712-4961-a2a4-4a9672235cea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updated VIF entry in instance network info cache for port 9f3a452b-b466-40bd-809e-38d61cd3ba5e. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:37:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-bf70c2d5-182a-466c-95fa-48b33f06fe90 req-59ceda5a-6712-4961-a2a4-4a9672235cea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updating instance_info_cache with network_info: [{"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:37:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bf70c2d5-182a-466c-95fa-48b33f06fe90 req-59ceda5a-6712-4961-a2a4-4a9672235cea service nova] Releasing lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:37:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:07 user nova-compute[73627]: INFO nova.compute.manager [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Rebooting instance
Aug 26 16:37:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:37:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquired lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:37:07 user nova-compute[73627]: DEBUG nova.network.neutron [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:37:07 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:37:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:07 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:37:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG nova.network.neutron [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updating instance_info_cache with network_info: [{"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Releasing lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG nova.compute.manager [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-f8b3410e-4b75-47f2-a98c-965b3c933140 req-7e7bd25a-2f93-4393-afe1-b6fdfb7c938d service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-unplugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f8b3410e-4b75-47f2-a98c-965b3c933140 req-7e7bd25a-2f93-4393-afe1-b6fdfb7c938d service nova] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f8b3410e-4b75-47f2-a98c-965b3c933140 req-7e7bd25a-2f93-4393-afe1-b6fdfb7c938d service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f8b3410e-4b75-47f2-a98c-965b3c933140 req-7e7bd25a-2f93-4393-afe1-b6fdfb7c938d service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-f8b3410e-4b75-47f2-a98c-965b3c933140 req-7e7bd25a-2f93-4393-afe1-b6fdfb7c938d service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] No waiting events found dispatching network-vif-unplugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:37:08 user nova-compute[73627]: WARNING nova.compute.manager [req-f8b3410e-4b75-47f2-a98c-965b3c933140 req-7e7bd25a-2f93-4393-afe1-b6fdfb7c938d service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received unexpected event network-vif-unplugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e for instance with vm_state active and task_state reboot_started_hard.
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:08 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Instance destroyed successfully.
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.objects.instance [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'resources' on Instance uuid 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401986763',display_name='tempest-TestMinimumBasicScenario-server-1401986763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401986763',id=31,image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvGb6OgS4/exGLauNisDrmDk77vIvVYHyzKMvy12SdxmWjlFxuHxBz+ABfkBoNAITGCTjFnOALKtOiV1awPZM4LY5xuhILyJgwDK9Pu86m2c2Mbjfxy5ew/i3hBTH56bA==',key_name='tempest-TestMinimumBasicScenario-1334019721',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c5a07134941420ba915917e23449851',ramdisk_id='',reservation_id='r-ym847cwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-808712581',owner_user_name='tempest-TestMinimumBasicScenario-808712581-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:37:08Z,user_data=None,user_id='a676ca6fc331417d8f835ebcf8181cfb',uuid=8e049438-4a89-4bc9-bd98-397c8c699fc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converting VIF {"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_vif [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f3a452b-b4, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: INFO os_vif [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4')
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJUNMurS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:37:09 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7ed9ea-38a0-4bd9-acbe-79e62f2c8c6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7346406f-ffba-4aac-abeb-83fec8e2f180]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:37:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:37:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d0243eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262'): ({'sdd'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Removing single pathed devices sdd {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[db01653b-02f0-4279-a210-9309b4853faf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f534a2e-d896-4d3f-80b1-e50efa738215]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Flushing IO for device /dev/sdd {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[536e504c-ee9f-4ef3-9454-105b19b90f7c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96d5cb1-b774-4e51-9f37-7fd91e5b2052]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6650739c-dcc2-4431-b03f-b4f1a874aa3c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da91622-98f1-461c-b916-8caf65e75a1a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260]
Aug 26 16:37:09 user nova-compute[73627]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260] successful.
Aug 26 16:37:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d78d02-3c2e-4852-87a9-682f975a822b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] <== disconnect_volume: return (292ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Start _get_guest_xml network_info=[{"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53282c5c-8791-40e6-b0f8-6ba17d690089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '53282c5c-8791-40e6-b0f8-6ba17d690089'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJUNMurS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '8e049438-4a89-4bc9-bd98-397c8c699fc9', 'attached_at': '', 'detached_at': '', 'volume_id': '363ef156-d623-44d4-a815-6526e108a262', 'serial': '363ef156-d623-44d4-a815-6526e108a262'}, 'guest_format': None, 'attachment_id': '6ec51e5e-a02f-4a0e-bcbd-eb1ed2d0afd8', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:37:09 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:37:09 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53282c5c-8791-40e6-b0f8-6ba17d690089,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.objects.instance [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.objects.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Object Instance<8e049438-4a89-4bc9-bd98-397c8c699fc9> lazy-loaded attributes: resources,vcpu_model {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJUNMurS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:37:09 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:37:09 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:37:09 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad640f6-70bd-4159-9c7a-e6b456ed3515]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:37:09 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4f9925-e7aa-4cc0-aa7f-127e66e10385]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262] added
Aug 26 16:37:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b4e0bd-c397-4a82-a8ad-1c1ca57d84df]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8806d53b-506e-4c9b-afcc-f30f87fc6895]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dJUNMurS {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dJUNMurS" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2ee1a0-0d0f-4ad6-a9aa-8156a8e68224]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dJUNMurS'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[91938af7-d790-4cc6-ae59-46b56765b5ed]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[284cc067-a686-4cd0-a24b-e6e6a0b71dfa]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:37:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:37:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2625fb1c-b809-4565-ba80-2f2cb21181af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260]
Aug 26 16:37:09 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260] successful.
Aug 26 16:37:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aec753-6c9d-4fa1-b99a-6e24fd967253]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df8859f-2041-456c-b1fe-b79afa980f1d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:37:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:37:09 user nova-compute[73627]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:37:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa039895-c88f-4c73-9c1a-9ff577b1aa29]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:37:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJUNMurS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-e7cce37e-6afb-4f9f-a0f2-bddfcc2fe3c0 req-d903d38c-d0b5-413e-b216-14c51308d77f service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e7cce37e-6afb-4f9f-a0f2-bddfcc2fe3c0 req-d903d38c-d0b5-413e-b216-14c51308d77f service nova] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e7cce37e-6afb-4f9f-a0f2-bddfcc2fe3c0 req-d903d38c-d0b5-413e-b216-14c51308d77f service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e7cce37e-6afb-4f9f-a0f2-bddfcc2fe3c0 req-d903d38c-d0b5-413e-b216-14c51308d77f service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-e7cce37e-6afb-4f9f-a0f2-bddfcc2fe3c0 req-d903d38c-d0b5-413e-b216-14c51308d77f service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] No waiting events found dispatching network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:37:10 user nova-compute[73627]: WARNING nova.compute.manager [req-e7cce37e-6afb-4f9f-a0f2-bddfcc2fe3c0 req-d903d38c-d0b5-413e-b216-14c51308d77f service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received unexpected event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e for instance with vm_state active and task_state reboot_started_hard.
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23263636235643861', 'path': '/dev/sdd'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:37:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263636235643861', 'path': '/dev/sdd'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401986763',display_name='tempest-TestMinimumBasicScenario-server-1401986763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401986763',id=31,image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvGb6OgS4/exGLauNisDrmDk77vIvVYHyzKMvy12SdxmWjlFxuHxBz+ABfkBoNAITGCTjFnOALKtOiV1awPZM4LY5xuhILyJgwDK9Pu86m2c2Mbjfxy5ew/i3hBTH56bA==',key_name='tempest-TestMinimumBasicScenario-1334019721',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c5a07134941420ba915917e23449851',ramdisk_id='',reservation_id='r-ym847cwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-808712581',owner_user_name='tempest-TestMinimumBasicScenario-808712581-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:37:08Z,user_data=None,user_id='a676ca6fc331417d8f835ebcf8181cfb',uuid=8e049438-4a89-4bc9-bd98-397c8c699fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converting VIF {"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.objects.instance [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.objects.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Object Instance<8e049438-4a89-4bc9-bd98-397c8c699fc9> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:37:11 user nova-compute[73627]:   <uuid>8e049438-4a89-4bc9-bd98-397c8c699fc9</uuid>
Aug 26 16:37:11 user nova-compute[73627]:   <name>instance-0000001f</name>
Aug 26 16:37:11 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:37:11 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:37:11 user nova-compute[73627]:   <metadata>
Aug 26 16:37:11 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:37:11 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:37:11 user nova-compute[73627]:       <nova:name>tempest-TestMinimumBasicScenario-server-1401986763</nova:name>
Aug 26 16:37:11 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:37:09</nova:creationTime>
Aug 26 16:37:11 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:37:11 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:37:11 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:37:11 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:37:11 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:37:11 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:37:11 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:37:11 user nova-compute[73627]:       <nova:owner>
Aug 26 16:37:11 user nova-compute[73627]:         <nova:user uuid="a676ca6fc331417d8f835ebcf8181cfb">tempest-TestMinimumBasicScenario-808712581-project-member</nova:user>
Aug 26 16:37:11 user nova-compute[73627]:         <nova:project uuid="0c5a07134941420ba915917e23449851">tempest-TestMinimumBasicScenario-808712581</nova:project>
Aug 26 16:37:11 user nova-compute[73627]:       </nova:owner>
Aug 26 16:37:11 user nova-compute[73627]:       <nova:root type="image" uuid="53282c5c-8791-40e6-b0f8-6ba17d690089"/>
Aug 26 16:37:11 user nova-compute[73627]:       <nova:ports>
Aug 26 16:37:11 user nova-compute[73627]:         <nova:port uuid="9f3a452b-b466-40bd-809e-38d61cd3ba5e">
Aug 26 16:37:11 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 16:37:11 user nova-compute[73627]:         </nova:port>
Aug 26 16:37:11 user nova-compute[73627]:       </nova:ports>
Aug 26 16:37:11 user nova-compute[73627]:     </nova:instance>
Aug 26 16:37:11 user nova-compute[73627]:   </metadata>
Aug 26 16:37:11 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:37:11 user nova-compute[73627]:     <system>
Aug 26 16:37:11 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:37:11 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:37:11 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:37:11 user nova-compute[73627]:       <entry name="serial">8e049438-4a89-4bc9-bd98-397c8c699fc9</entry>
Aug 26 16:37:11 user nova-compute[73627]:       <entry name="uuid">8e049438-4a89-4bc9-bd98-397c8c699fc9</entry>
Aug 26 16:37:11 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:37:11 user nova-compute[73627]:     </system>
Aug 26 16:37:11 user nova-compute[73627]:   </sysinfo>
Aug 26 16:37:11 user nova-compute[73627]:   <os>
Aug 26 16:37:11 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:37:11 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:37:11 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:37:11 user nova-compute[73627]:   </os>
Aug 26 16:37:11 user nova-compute[73627]:   <features>
Aug 26 16:37:11 user nova-compute[73627]:     <acpi/>
Aug 26 16:37:11 user nova-compute[73627]:     <apic/>
Aug 26 16:37:11 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:37:11 user nova-compute[73627]:   </features>
Aug 26 16:37:11 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:37:11 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:37:11 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:37:11 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:37:11 user nova-compute[73627]:   </clock>
Aug 26 16:37:11 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:37:11 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:37:11 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:37:11 user nova-compute[73627]:   </cpu>
Aug 26 16:37:11 user nova-compute[73627]:   <devices>
Aug 26 16:37:11 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:37:11 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:37:11 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk"/>
Aug 26 16:37:11 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:37:11 user nova-compute[73627]:     </disk>
Aug 26 16:37:11 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:37:11 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:37:11 user nova-compute[73627]:       <source dev="/dev/sdd"/>
Aug 26 16:37:11 user nova-compute[73627]:       <target dev="vdb" bus="virtio"/>
Aug 26 16:37:11 user nova-compute[73627]:       <serial>363ef156-d623-44d4-a815-6526e108a262</serial>
Aug 26 16:37:11 user nova-compute[73627]:     </disk>
Aug 26 16:37:11 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:37:11 user nova-compute[73627]:       <mac address="fa:16:3e:6e:27:2c"/>
Aug 26 16:37:11 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:37:11 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:37:11 user nova-compute[73627]:       <target dev="tap9f3a452b-b4"/>
Aug 26 16:37:11 user nova-compute[73627]:     </interface>
Aug 26 16:37:11 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:37:11 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/console.log" append="off"/>
Aug 26 16:37:11 user nova-compute[73627]:     </serial>
Aug 26 16:37:11 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:37:11 user nova-compute[73627]:     <video>
Aug 26 16:37:11 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:37:11 user nova-compute[73627]:     </video>
Aug 26 16:37:11 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:37:11 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:37:11 user nova-compute[73627]:     </rng>
Aug 26 16:37:11 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:37:11 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:37:11 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:37:11 user nova-compute[73627]:     </memballoon>
Aug 26 16:37:11 user nova-compute[73627]:   </devices>
Aug 26 16:37:11 user nova-compute[73627]: </domain>
Aug 26 16:37:11 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.objects.instance [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.objects.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Object Instance<8e049438-4a89-4bc9-bd98-397c8c699fc9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522 --force-share --output=json" returned: 0 in 0.169s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Cannot resize image /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.objects.instance [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'migration_context' on Instance uuid 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.objects.base [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Object Instance<8e049438-4a89-4bc9-bd98-397c8c699fc9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401986763',display_name='tempest-TestMinimumBasicScenario-server-1401986763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401986763',id=31,image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvGb6OgS4/exGLauNisDrmDk77vIvVYHyzKMvy12SdxmWjlFxuHxBz+ABfkBoNAITGCTjFnOALKtOiV1awPZM4LY5xuhILyJgwDK9Pu86m2c2Mbjfxy5ew/i3hBTH56bA==',key_name='tempest-TestMinimumBasicScenario-1334019721',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='0c5a07134941420ba915917e23449851',ramdisk_id='',reservation_id='r-ym847cwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-808712581',owner_user_name='tempest-TestMinimumBasicScenario-808712581-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:37:08Z,user_data=None,user_id='a676ca6fc331417d8f835ebcf8181cfb',uuid=8e049438-4a89-4bc9-bd98-397c8c699fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converting VIF {"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG os_vif [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f3a452b-b4, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f3a452b-b4, col_values=(('external_ids', {'iface-id': '9f3a452b-b466-40bd-809e-38d61cd3ba5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:27:2c', 'vm-uuid': '8e049438-4a89-4bc9-bd98-397c8c699fc9'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:11 user nova-compute[73627]: INFO os_vif [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4')
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-4a50b3aa-d96f-4ada-970a-686b199678a2 req-fcb745b4-2cba-40fd-9e60-884b177eadef service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4a50b3aa-d96f-4ada-970a-686b199678a2 req-fcb745b4-2cba-40fd-9e60-884b177eadef service nova] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4a50b3aa-d96f-4ada-970a-686b199678a2 req-fcb745b4-2cba-40fd-9e60-884b177eadef service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4a50b3aa-d96f-4ada-970a-686b199678a2 req-fcb745b4-2cba-40fd-9e60-884b177eadef service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-4a50b3aa-d96f-4ada-970a-686b199678a2 req-fcb745b4-2cba-40fd-9e60-884b177eadef service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] No waiting events found dispatching network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:37:16 user nova-compute[73627]: WARNING nova.compute.manager [req-4a50b3aa-d96f-4ada-970a-686b199678a2 req-fcb745b4-2cba-40fd-9e60-884b177eadef service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received unexpected event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e for instance with vm_state active and task_state reboot_started_hard.
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-d339ab02-4fa2-413c-acee-60a92e82a4f2 req-a743db4b-3b09-41bb-a75f-32ef60c26250 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d339ab02-4fa2-413c-acee-60a92e82a4f2 req-a743db4b-3b09-41bb-a75f-32ef60c26250 service nova] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d339ab02-4fa2-413c-acee-60a92e82a4f2 req-a743db4b-3b09-41bb-a75f-32ef60c26250 service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d339ab02-4fa2-413c-acee-60a92e82a4f2 req-a743db4b-3b09-41bb-a75f-32ef60c26250 service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-d339ab02-4fa2-413c-acee-60a92e82a4f2 req-a743db4b-3b09-41bb-a75f-32ef60c26250 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] No waiting events found dispatching network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:37:16 user nova-compute[73627]: WARNING nova.compute.manager [req-d339ab02-4fa2-413c-acee-60a92e82a4f2 req-a743db4b-3b09-41bb-a75f-32ef60c26250 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received unexpected event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e for instance with vm_state active and task_state reboot_started_hard.
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Removed pending event for 8e049438-4a89-4bc9-bd98-397c8c699fc9 due to event {{(pid=73627) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067835.6013775, 8e049438-4a89-4bc9-bd98-397c8c699fc9 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:37:16 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] VM Resumed (Lifecycle Event)
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:16 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:37:16 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=7265MB free_disk=25.229896545410156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:16 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Instance rebooted successfully.
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:37:16 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067835.6023273, 8e049438-4a89-4bc9-bd98-397c8c699fc9 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:37:16 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] VM Started (Lifecycle Event)
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-3ce7db73-a2d9-4254-877e-dc7d60aee5f8 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.657s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "8164bb99-842e-49fc-8f36-093de455c311" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "8164bb99-842e-49fc-8f36-093de455c311" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "8164bb99-842e-49fc-8f36-093de455c311-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "8164bb99-842e-49fc-8f36-093de455c311-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "8164bb99-842e-49fc-8f36-093de455c311-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8164bb99-842e-49fc-8f36-093de455c311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance daca1645-10d4-45e7-874a-b2972a494e6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 914c5004-52af-4826-914d-ca3d215cf040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b5277d78-3a96-4d79-8825-26d042254c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f9416f88-5192-4ffd-ae4b-1a521913d824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8e049438-4a89-4bc9-bd98-397c8c699fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 98114285-9c1d-4ff4-9121-77bd1a798200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:37:16 user nova-compute[73627]: INFO nova.compute.manager [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Terminating instance
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 11b98779-e085-4af6-a5eb-59350f4a4d52 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-eeddf87b-98d2-4324-9219-c417456adaee req-03c08717-06ca-4956-be6a-47674b2fbf22 service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Received event network-vif-unplugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-eeddf87b-98d2-4324-9219-c417456adaee req-03c08717-06ca-4956-be6a-47674b2fbf22 service nova] Acquiring lock "8164bb99-842e-49fc-8f36-093de455c311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-eeddf87b-98d2-4324-9219-c417456adaee req-03c08717-06ca-4956-be6a-47674b2fbf22 service nova] Lock "8164bb99-842e-49fc-8f36-093de455c311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-eeddf87b-98d2-4324-9219-c417456adaee req-03c08717-06ca-4956-be6a-47674b2fbf22 service nova] Lock "8164bb99-842e-49fc-8f36-093de455c311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-eeddf87b-98d2-4324-9219-c417456adaee req-03c08717-06ca-4956-be6a-47674b2fbf22 service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] No waiting events found dispatching network-vif-unplugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-eeddf87b-98d2-4324-9219-c417456adaee req-03c08717-06ca-4956-be6a-47674b2fbf22 service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Received event network-vif-unplugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.492s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:16 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:37:16 user nova-compute[73627]: INFO nova.compute.claims [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Claim successful on node user
Aug 26 16:37:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Instance destroyed successfully.
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lazy-loading 'resources' on Instance uuid 8164bb99-842e-49fc-8f36-093de455c311 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-597401726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-597401726',id=2,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8b8b30c15b8423e90156082111b000f',ramdisk_id='',reservation_id='r-3f0s15f4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:25:06Z,user_data=None,user_id='f24169ea97724e1288631ea977a068bd',uuid=8164bb99-842e-49fc-8f36-093de455c311,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converting VIF {"id": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "address": "fa:16:3e:d2:fa:c8", "network": {"id": "883d1a4a-5464-42d4-8a12-de31a0ce1057", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1319534677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b8b30c15b8423e90156082111b000f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241ea534-a7", "ovs_interfaceid": "241ea534-a7ce-437b-9e82-8ed8ffe61c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:fa:c8,bridge_name='br-int',has_traffic_filtering=True,id=241ea534-a7ce-437b-9e82-8ed8ffe61c09,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241ea534-a7') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG os_vif [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:fa:c8,bridge_name='br-int',has_traffic_filtering=True,id=241ea534-a7ce-437b-9e82-8ed8ffe61c09,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241ea534-a7') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap241ea534-a7, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:37:17 user nova-compute[73627]: INFO os_vif [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:fa:c8,bridge_name='br-int',has_traffic_filtering=True,id=241ea534-a7ce-437b-9e82-8ed8ffe61c09,network=Network(883d1a4a-5464-42d4-8a12-de31a0ce1057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241ea534-a7')
Aug 26 16:37:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Deleting instance files /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311_del
Aug 26 16:37:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Deletion of /opt/stack/data/nova/instances/8164bb99-842e-49fc-8f36-093de455c311_del complete
Aug 26 16:37:17 user nova-compute[73627]: INFO nova.compute.manager [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 8164bb99-842e-49fc-8f36-093de455c311] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.network.neutron [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:37:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.policy [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5067f58846cf44fc9799db04de44d116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875ad08232174cb391be66a7d5605d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:37:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Creating image(s)
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "/opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "/opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "/opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.192s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:37:17 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Took 0.71 seconds to deallocate network for instance.
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.211s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk 1073741824" returned: 0 in 0.060s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.194s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.network.neutron [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Successfully created port: 766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Cannot resize image /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Ensure instance console log exists: /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:18 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Deleted allocations for instance 8164bb99-842e-49fc-8f36-093de455c311
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4aa7f2da-d040-4c14-b663-fd10b748fe8f tempest-ServerBootFromVolumeStableRescueTest-2135030864 tempest-ServerBootFromVolumeStableRescueTest-2135030864-project-member] Lock "8164bb99-842e-49fc-8f36-093de455c311" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.455s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.compute.manager [req-a5f4f32e-efa2-4706-8a7f-2fb5b0df20c4 req-705eb104-4a32-44a2-9251-12f382ba91ed service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Received event network-vif-plugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a5f4f32e-efa2-4706-8a7f-2fb5b0df20c4 req-705eb104-4a32-44a2-9251-12f382ba91ed service nova] Acquiring lock "8164bb99-842e-49fc-8f36-093de455c311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a5f4f32e-efa2-4706-8a7f-2fb5b0df20c4 req-705eb104-4a32-44a2-9251-12f382ba91ed service nova] Lock "8164bb99-842e-49fc-8f36-093de455c311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a5f4f32e-efa2-4706-8a7f-2fb5b0df20c4 req-705eb104-4a32-44a2-9251-12f382ba91ed service nova] Lock "8164bb99-842e-49fc-8f36-093de455c311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.compute.manager [req-a5f4f32e-efa2-4706-8a7f-2fb5b0df20c4 req-705eb104-4a32-44a2-9251-12f382ba91ed service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] No waiting events found dispatching network-vif-plugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:37:18 user nova-compute[73627]: WARNING nova.compute.manager [req-a5f4f32e-efa2-4706-8a7f-2fb5b0df20c4 req-705eb104-4a32-44a2-9251-12f382ba91ed service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Received unexpected event network-vif-plugged-241ea534-a7ce-437b-9e82-8ed8ffe61c09 for instance with vm_state deleted and task_state None.
Aug 26 16:37:18 user nova-compute[73627]: DEBUG nova.compute.manager [req-a5f4f32e-efa2-4706-8a7f-2fb5b0df20c4 req-705eb104-4a32-44a2-9251-12f382ba91ed service nova] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Received event network-vif-deleted-241ea534-a7ce-437b-9e82-8ed8ffe61c09 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Successfully updated port: 766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "refresh_cache-11b98779-e085-4af6-a5eb-59350f4a4d52" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquired lock "refresh_cache-11b98779-e085-4af6-a5eb-59350f4a4d52" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-75b56cfe-6901-4a45-83f0-ccf3a2c6f45f req-e95797b7-b089-4345-8eb9-d2483312f954 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Received event network-changed-766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-75b56cfe-6901-4a45-83f0-ccf3a2c6f45f req-e95797b7-b089-4345-8eb9-d2483312f954 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Refreshing instance network info cache due to event network-changed-766c5422-05f4-4eca-96c7-c646c45a5fd1. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-75b56cfe-6901-4a45-83f0-ccf3a2c6f45f req-e95797b7-b089-4345-8eb9-d2483312f954 service nova] Acquiring lock "refresh_cache-11b98779-e085-4af6-a5eb-59350f4a4d52" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updating instance_info_cache with network_info: [{"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Updating instance_info_cache with network_info: [{"id": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "address": "fa:16:3e:71:b0:94", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c5422-05", "ovs_interfaceid": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Releasing lock "refresh_cache-11b98779-e085-4af6-a5eb-59350f4a4d52" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Instance network_info: |[{"id": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "address": "fa:16:3e:71:b0:94", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c5422-05", "ovs_interfaceid": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-75b56cfe-6901-4a45-83f0-ccf3a2c6f45f req-e95797b7-b089-4345-8eb9-d2483312f954 service nova] Acquired lock "refresh_cache-11b98779-e085-4af6-a5eb-59350f4a4d52" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.network.neutron [req-75b56cfe-6901-4a45-83f0-ccf3a2c6f45f req-e95797b7-b089-4345-8eb9-d2483312f954 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Refreshing network info cache for port 766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Start _get_guest_xml network_info=[{"id": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "address": "fa:16:3e:71:b0:94", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c5422-05", "ovs_interfaceid": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:37:19 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:37:19 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800808689',display_name='tempest-AttachVolumeTestJSON-server-800808689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-800808689',id=33,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUUWKK7k1zxFZzwYG/3BOHWTPUpogxztBGVECSrZrhWTrVA1un2Okr2Ve2OTeczPBjzvoz6PqQFY8mw1ORdnB37VCWO45tIHZ7IZvU3RoW5EioUHXfOn8m14Tddxjo35Q==',key_name='tempest-keypair-1090823722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0wvdm2zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=11b98779-e085-4af6-a5eb-59350f4a4d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "address": "fa:16:3e:71:b0:94", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c5422-05", "ovs_interfaceid": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "address": "fa:16:3e:71:b0:94", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c5422-05", "ovs_interfaceid": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=766c5422-05f4-4eca-96c7-c646c45a5fd1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c5422-05') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.objects.instance [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'pci_devices' on Instance uuid 11b98779-e085-4af6-a5eb-59350f4a4d52 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:37:19 user nova-compute[73627]:   <uuid>11b98779-e085-4af6-a5eb-59350f4a4d52</uuid>
Aug 26 16:37:19 user nova-compute[73627]:   <name>instance-00000021</name>
Aug 26 16:37:19 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:37:19 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:37:19 user nova-compute[73627]:   <metadata>
Aug 26 16:37:19 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:37:19 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:37:19 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeTestJSON-server-800808689</nova:name>
Aug 26 16:37:19 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:37:19</nova:creationTime>
Aug 26 16:37:19 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:37:19 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:37:19 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:37:19 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:37:19 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:37:19 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:37:19 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:37:19 user nova-compute[73627]:       <nova:owner>
Aug 26 16:37:19 user nova-compute[73627]:         <nova:user uuid="5067f58846cf44fc9799db04de44d116">tempest-AttachVolumeTestJSON-1152498749-project-member</nova:user>
Aug 26 16:37:19 user nova-compute[73627]:         <nova:project uuid="875ad08232174cb391be66a7d5605d8d">tempest-AttachVolumeTestJSON-1152498749</nova:project>
Aug 26 16:37:19 user nova-compute[73627]:       </nova:owner>
Aug 26 16:37:19 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:37:19 user nova-compute[73627]:       <nova:ports>
Aug 26 16:37:19 user nova-compute[73627]:         <nova:port uuid="766c5422-05f4-4eca-96c7-c646c45a5fd1">
Aug 26 16:37:19 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 16:37:19 user nova-compute[73627]:         </nova:port>
Aug 26 16:37:19 user nova-compute[73627]:       </nova:ports>
Aug 26 16:37:19 user nova-compute[73627]:     </nova:instance>
Aug 26 16:37:19 user nova-compute[73627]:   </metadata>
Aug 26 16:37:19 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:37:19 user nova-compute[73627]:     <system>
Aug 26 16:37:19 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:37:19 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:37:19 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:37:19 user nova-compute[73627]:       <entry name="serial">11b98779-e085-4af6-a5eb-59350f4a4d52</entry>
Aug 26 16:37:19 user nova-compute[73627]:       <entry name="uuid">11b98779-e085-4af6-a5eb-59350f4a4d52</entry>
Aug 26 16:37:19 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:37:19 user nova-compute[73627]:     </system>
Aug 26 16:37:19 user nova-compute[73627]:   </sysinfo>
Aug 26 16:37:19 user nova-compute[73627]:   <os>
Aug 26 16:37:19 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:37:19 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:37:19 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:37:19 user nova-compute[73627]:   </os>
Aug 26 16:37:19 user nova-compute[73627]:   <features>
Aug 26 16:37:19 user nova-compute[73627]:     <acpi/>
Aug 26 16:37:19 user nova-compute[73627]:     <apic/>
Aug 26 16:37:19 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:37:19 user nova-compute[73627]:   </features>
Aug 26 16:37:19 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:37:19 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:37:19 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:37:19 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:37:19 user nova-compute[73627]:   </clock>
Aug 26 16:37:19 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:37:19 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:37:19 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:37:19 user nova-compute[73627]:   </cpu>
Aug 26 16:37:19 user nova-compute[73627]:   <devices>
Aug 26 16:37:19 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:37:19 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:37:19 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk"/>
Aug 26 16:37:19 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:37:19 user nova-compute[73627]:     </disk>
Aug 26 16:37:19 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:37:19 user nova-compute[73627]:       <mac address="fa:16:3e:71:b0:94"/>
Aug 26 16:37:19 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:37:19 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:37:19 user nova-compute[73627]:       <target dev="tap766c5422-05"/>
Aug 26 16:37:19 user nova-compute[73627]:     </interface>
Aug 26 16:37:19 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:37:19 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/console.log" append="off"/>
Aug 26 16:37:19 user nova-compute[73627]:     </serial>
Aug 26 16:37:19 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:37:19 user nova-compute[73627]:     <video>
Aug 26 16:37:19 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:37:19 user nova-compute[73627]:     </video>
Aug 26 16:37:19 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:37:19 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:37:19 user nova-compute[73627]:     </rng>
Aug 26 16:37:19 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:37:19 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:37:19 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:37:19 user nova-compute[73627]:     </memballoon>
Aug 26 16:37:19 user nova-compute[73627]:   </devices>
Aug 26 16:37:19 user nova-compute[73627]: </domain>
Aug 26 16:37:19 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800808689',display_name='tempest-AttachVolumeTestJSON-server-800808689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-800808689',id=33,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUUWKK7k1zxFZzwYG/3BOHWTPUpogxztBGVECSrZrhWTrVA1un2Okr2Ve2OTeczPBjzvoz6PqQFY8mw1ORdnB37VCWO45tIHZ7IZvU3RoW5EioUHXfOn8m14Tddxjo35Q==',key_name='tempest-keypair-1090823722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0wvdm2zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=11b98779-e085-4af6-a5eb-59350f4a4d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "address": "fa:16:3e:71:b0:94", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c5422-05", "ovs_interfaceid": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "address": "fa:16:3e:71:b0:94", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c5422-05", "ovs_interfaceid": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=766c5422-05f4-4eca-96c7-c646c45a5fd1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c5422-05') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG os_vif [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=766c5422-05f4-4eca-96c7-c646c45a5fd1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c5422-05') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap766c5422-05, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap766c5422-05, col_values=(('external_ids', {'iface-id': '766c5422-05f4-4eca-96c7-c646c45a5fd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:b0:94', 'vm-uuid': '11b98779-e085-4af6-a5eb-59350f4a4d52'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:19 user nova-compute[73627]: INFO os_vif [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=766c5422-05f4-4eca-96c7-c646c45a5fd1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c5422-05')
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:37:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No VIF found with MAC fa:16:3e:71:b0:94, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-75b56cfe-6901-4a45-83f0-ccf3a2c6f45f req-e95797b7-b089-4345-8eb9-d2483312f954 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Updated VIF entry in instance network info cache for port 766c5422-05f4-4eca-96c7-c646c45a5fd1. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-75b56cfe-6901-4a45-83f0-ccf3a2c6f45f req-e95797b7-b089-4345-8eb9-d2483312f954 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Updating instance_info_cache with network_info: [{"id": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "address": "fa:16:3e:71:b0:94", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c5422-05", "ovs_interfaceid": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-75b56cfe-6901-4a45-83f0-ccf3a2c6f45f req-e95797b7-b089-4345-8eb9-d2483312f954 service nova] Releasing lock "refresh_cache-11b98779-e085-4af6-a5eb-59350f4a4d52" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f9416f88-5192-4ffd-ae4b-1a521913d824" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:20 user nova-compute[73627]: INFO nova.compute.manager [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Terminating instance
Aug 26 16:37:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-516e5bab-4a09-48de-955f-a11ff36df1ad req-c8e95bde-37ef-43ee-8db1-cdc97ec47f3e service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Received event network-vif-unplugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-516e5bab-4a09-48de-955f-a11ff36df1ad req-c8e95bde-37ef-43ee-8db1-cdc97ec47f3e service nova] Acquiring lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-516e5bab-4a09-48de-955f-a11ff36df1ad req-c8e95bde-37ef-43ee-8db1-cdc97ec47f3e service nova] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-516e5bab-4a09-48de-955f-a11ff36df1ad req-c8e95bde-37ef-43ee-8db1-cdc97ec47f3e service nova] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-516e5bab-4a09-48de-955f-a11ff36df1ad req-c8e95bde-37ef-43ee-8db1-cdc97ec47f3e service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] No waiting events found dispatching network-vif-unplugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-516e5bab-4a09-48de-955f-a11ff36df1ad req-c8e95bde-37ef-43ee-8db1-cdc97ec47f3e service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Received event network-vif-unplugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:37:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:37:21 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Instance destroyed successfully.
Aug 26 16:37:21 user nova-compute[73627]: DEBUG nova.objects.instance [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lazy-loading 'resources' on Instance uuid f9416f88-5192-4ffd-ae4b-1a521913d824 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:34:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1609521558',display_name='tempest-AttachVolumeNegativeTest-server-1609521558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1609521558',id=30,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDj9IHQWS7P43+8m83fa7VMysmE5r80ULH/YKXlvrhfpGaYe802a0Vg8tB52n9f9yn5QVTzJrVkSmeOD4ZGbveG0TR4E9JtEd5G9ILpp5IYQgHAZuddY4FZ/IpbKsEd1yQ==',key_name='tempest-keypair-156072886',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:34:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78924631c2e241b0b0c5cb8c9c24b4a4',ramdisk_id='',reservation_id='r-wv0awocy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1218878917',owner_user_name='tempest-AttachVolumeNegativeTest-1218878917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:34:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d643e68350c749df9a033c5ee9bae19f',uuid=f9416f88-5192-4ffd-ae4b-1a521913d824,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "address": "fa:16:3e:d9:c1:91", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036e9d53-5a", "ovs_interfaceid": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converting VIF {"id": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "address": "fa:16:3e:d9:c1:91", "network": {"id": "1e09834a-57f7-4e8f-a075-456a17a82461", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1608199204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78924631c2e241b0b0c5cb8c9c24b4a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap036e9d53-5a", "ovs_interfaceid": "036e9d53-5a7f-4d85-834b-0c4d4fdc7f31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c1:91,bridge_name='br-int',has_traffic_filtering=True,id=036e9d53-5a7f-4d85-834b-0c4d4fdc7f31,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036e9d53-5a') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG os_vif [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c1:91,bridge_name='br-int',has_traffic_filtering=True,id=036e9d53-5a7f-4d85-834b-0c4d4fdc7f31,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036e9d53-5a') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap036e9d53-5a, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:21 user nova-compute[73627]: INFO os_vif [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c1:91,bridge_name='br-int',has_traffic_filtering=True,id=036e9d53-5a7f-4d85-834b-0c4d4fdc7f31,network=Network(1e09834a-57f7-4e8f-a075-456a17a82461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap036e9d53-5a')
Aug 26 16:37:21 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Deleting instance files /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824_del
Aug 26 16:37:21 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Deletion of /opt/stack/data/nova/instances/f9416f88-5192-4ffd-ae4b-1a521913d824_del complete
Aug 26 16:37:21 user nova-compute[73627]: INFO nova.compute.manager [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 26 16:37:21 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-38fb8182-222d-4a66-ac84-28ceaa0e33d6 req-7a6920bc-8559-4f9a-b07a-e221643d2838 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Received event network-vif-plugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-38fb8182-222d-4a66-ac84-28ceaa0e33d6 req-7a6920bc-8559-4f9a-b07a-e221643d2838 service nova] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-38fb8182-222d-4a66-ac84-28ceaa0e33d6 req-7a6920bc-8559-4f9a-b07a-e221643d2838 service nova] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-38fb8182-222d-4a66-ac84-28ceaa0e33d6 req-7a6920bc-8559-4f9a-b07a-e221643d2838 service nova] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-38fb8182-222d-4a66-ac84-28ceaa0e33d6 req-7a6920bc-8559-4f9a-b07a-e221643d2838 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] No waiting events found dispatching network-vif-plugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:37:21 user nova-compute[73627]: WARNING nova.compute.manager [req-38fb8182-222d-4a66-ac84-28ceaa0e33d6 req-7a6920bc-8559-4f9a-b07a-e221643d2838 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Received unexpected event network-vif-plugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 for instance with vm_state building and task_state spawning.
Aug 26 16:37:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-7a72536d-2ba9-4ccb-91df-c24b222c21fc req-ed4a0c63-0365-48a1-a79f-6783f841deb6 service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Received event network-vif-plugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7a72536d-2ba9-4ccb-91df-c24b222c21fc req-ed4a0c63-0365-48a1-a79f-6783f841deb6 service nova] Acquiring lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7a72536d-2ba9-4ccb-91df-c24b222c21fc req-ed4a0c63-0365-48a1-a79f-6783f841deb6 service nova] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7a72536d-2ba9-4ccb-91df-c24b222c21fc req-ed4a0c63-0365-48a1-a79f-6783f841deb6 service nova] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-7a72536d-2ba9-4ccb-91df-c24b222c21fc req-ed4a0c63-0365-48a1-a79f-6783f841deb6 service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] No waiting events found dispatching network-vif-plugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:37:22 user nova-compute[73627]: WARNING nova.compute.manager [req-7a72536d-2ba9-4ccb-91df-c24b222c21fc req-ed4a0c63-0365-48a1-a79f-6783f841deb6 service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Received unexpected event network-vif-plugged-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 for instance with vm_state active and task_state deleting.
Aug 26 16:37:22 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:37:22 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Took 1.08 seconds to deallocate network for instance.
Aug 26 16:37:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-b8d0e6ca-edf7-4b14-850e-48b39c7296f5 req-467ec4a8-f6b5-4ce3-94e4-a521f02c724e service nova] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Received event network-vif-deleted-036e9d53-5a7f-4d85-834b-0c4d4fdc7f31 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:23 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Deleted allocations for instance f9416f88-5192-4ffd-ae4b-1a521913d824
Aug 26 16:37:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-fbecd35c-c43e-4c8b-91eb-2b4f97586bc0 tempest-AttachVolumeNegativeTest-1218878917 tempest-AttachVolumeNegativeTest-1218878917-project-member] Lock "f9416f88-5192-4ffd-ae4b-1a521913d824" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.141s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067843.8990364, 11b98779-e085-4af6-a5eb-59350f4a4d52 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:37:23 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] VM Resumed (Lifecycle Event)
Aug 26 16:37:23 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Instance spawned successfully.
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:37:23 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:37:23 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067843.8992422, 11b98779-e085-4af6-a5eb-59350f4a4d52 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:37:23 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] VM Started (Lifecycle Event)
Aug 26 16:37:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-42cd596d-aa3e-4f54-9893-e702903ea1e2 req-30ddc928-dda8-4bd0-a7d4-fee6a1d163c3 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Received event network-vif-plugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42cd596d-aa3e-4f54-9893-e702903ea1e2 req-30ddc928-dda8-4bd0-a7d4-fee6a1d163c3 service nova] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42cd596d-aa3e-4f54-9893-e702903ea1e2 req-30ddc928-dda8-4bd0-a7d4-fee6a1d163c3 service nova] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42cd596d-aa3e-4f54-9893-e702903ea1e2 req-30ddc928-dda8-4bd0-a7d4-fee6a1d163c3 service nova] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-42cd596d-aa3e-4f54-9893-e702903ea1e2 req-30ddc928-dda8-4bd0-a7d4-fee6a1d163c3 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] No waiting events found dispatching network-vif-plugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:37:24 user nova-compute[73627]: WARNING nova.compute.manager [req-42cd596d-aa3e-4f54-9893-e702903ea1e2 req-30ddc928-dda8-4bd0-a7d4-fee6a1d163c3 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Received unexpected event network-vif-plugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 for instance with vm_state building and task_state spawning.
Aug 26 16:37:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:37:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:37:24 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:37:24 user nova-compute[73627]: INFO nova.compute.manager [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Took 6.49 seconds to spawn the instance on the hypervisor.
Aug 26 16:37:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:37:24 user nova-compute[73627]: INFO nova.compute.manager [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Took 7.95 seconds to build instance.
Aug 26 16:37:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-abc4f359-0364-4589-a39b-98ac060c2904 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.110s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:32 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067837.111444, 8164bb99-842e-49fc-8f36-093de455c311 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:37:32 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 8164bb99-842e-49fc-8f36-093de455c311] VM Stopped (Lifecycle Event)
Aug 26 16:37:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-77e26cfa-b676-4153-af8c-94e397309947 None None] [instance: 8164bb99-842e-49fc-8f36-093de455c311] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:37:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:33 user nova-compute[73627]: INFO nova.compute.manager [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Detaching volume b0d891e3-b2f1-4638-9e12-cc767d416ac9
Aug 26 16:37:33 user nova-compute[73627]: INFO nova.virt.block_device [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Attempting to driver detach volume b0d891e3-b2f1-4638-9e12-cc767d416ac9 from mountpoint /dev/vdb
Aug 26 16:37:33 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Attempting to detach device vdb from instance b5277d78-3a96-4d79-8825-26d042254c12 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:37:33 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:37:33 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:37:33 user nova-compute[73627]:   <source dev="/dev/sde"/>
Aug 26 16:37:33 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:37:33 user nova-compute[73627]:   <serial>b0d891e3-b2f1-4638-9e12-cc767d416ac9</serial>
Aug 26 16:37:33 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 16:37:33 user nova-compute[73627]: </disk>
Aug 26 16:37:33 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:37:33 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully detached device vdb from instance b5277d78-3a96-4d79-8825-26d042254c12 from the persistent domain config.
Aug 26 16:37:33 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5277d78-3a96-4d79-8825-26d042254c12 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:37:33 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:37:33 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:37:33 user nova-compute[73627]:   <source dev="/dev/sde"/>
Aug 26 16:37:33 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:37:33 user nova-compute[73627]:   <serial>b0d891e3-b2f1-4638-9e12-cc767d416ac9</serial>
Aug 26 16:37:33 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 16:37:33 user nova-compute[73627]: </disk>
Aug 26 16:37:33 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067854.251882, b5277d78-3a96-4d79-8825-26d042254c12 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5277d78-3a96-4d79-8825-26d042254c12 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:37:34 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully detached device vdb from instance b5277d78-3a96-4d79-8825-26d042254c12 from the live domain config.
Aug 26 16:37:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYEBtHkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:37:34 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2bb870-e54a-4791-b212-0c7dab87ec09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[530c2db5-7115-4d72-a669-61e3ccb7d91f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:37:34 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:34 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:37:34 user nova-compute[73627]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:37:34 user nova-compute[73627]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd (non-flash)
Aug 26 16:37:34 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:37:34 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:34 user nova-compute[73627]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 (non-flash)
Aug 26 16:37:34 user nova-compute[73627]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:37:34 user nova-compute[73627]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd (non-flash)
Aug 26 16:37:34 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d01aa5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9'): ({'sde'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Removing single pathed devices sde {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6720b85a-c606-42b9-a828-268dd7871189]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabafa9d-e061-468d-a02f-96ad1c91b0d4]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flushing IO for device /dev/sde {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[42421968-3b85-40d6-83c9-f6da5ab54d89]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5c0568-9996-4b3e-afb8-35956e36a8f4]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] SCSI volumes sde have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6233b5de-0fb6-4bc8-8e02-1ef7f98cb153]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee092c5-7ff7-47af-9234-ee88076a6d4d]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260]
Aug 26 16:37:34 user nova-compute[73627]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9, portal: 172.16.0.220,3260] successful.
Aug 26 16:37:34 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d891e3-b2f1-4638-9e12-cc767d416ac9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ca6ebf-6a4a-45a2-9a5f-f2436b17ce83]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== disconnect_volume: return (306ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:37:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:37:35 user nova-compute[73627]: DEBUG nova.objects.instance [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'flavor' on Instance uuid b5277d78-3a96-4d79-8825-26d042254c12 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:37:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d68a1c0f-3296-404b-a360-9f54641f71d2 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.750s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:36 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067841.594397, f9416f88-5192-4ffd-ae4b-1a521913d824 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:37:36 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] VM Stopped (Lifecycle Event)
Aug 26 16:37:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-95d447fe-aab0-4018-9057-18e73dda3c5f None None] [instance: f9416f88-5192-4ffd-ae4b-1a521913d824] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:37:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-dec7896f-f2ae-446e-bb01-d4b27c2b8e83 req-ce0234b9-c7e9-4bd0-ab18-09074deb0117 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-changed-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-dec7896f-f2ae-446e-bb01-d4b27c2b8e83 req-ce0234b9-c7e9-4bd0-ab18-09074deb0117 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Refreshing instance network info cache due to event network-changed-6757dac8-c193-43e9-88cd-c4ac4d551120. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:37:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dec7896f-f2ae-446e-bb01-d4b27c2b8e83 req-ce0234b9-c7e9-4bd0-ab18-09074deb0117 service nova] Acquiring lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:37:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dec7896f-f2ae-446e-bb01-d4b27c2b8e83 req-ce0234b9-c7e9-4bd0-ab18-09074deb0117 service nova] Acquired lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:37:38 user nova-compute[73627]: DEBUG nova.network.neutron [req-dec7896f-f2ae-446e-bb01-d4b27c2b8e83 req-ce0234b9-c7e9-4bd0-ab18-09074deb0117 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Refreshing network info cache for port 6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:37:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:38 user nova-compute[73627]: INFO nova.compute.manager [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Detaching volume fc099332-184b-439e-8d5d-572771e03d0a
Aug 26 16:37:38 user nova-compute[73627]: INFO nova.virt.block_device [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Attempting to driver detach volume fc099332-184b-439e-8d5d-572771e03d0a from mountpoint /dev/vdb
Aug 26 16:37:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Attempting to detach device vdb from instance daca1645-10d4-45e7-874a-b2972a494e6e from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:37:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:37:38 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:37:38 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:37:38 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:37:38 user nova-compute[73627]:   <serial>fc099332-184b-439e-8d5d-572771e03d0a</serial>
Aug 26 16:37:38 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:37:38 user nova-compute[73627]: </disk>
Aug 26 16:37:38 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:37:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Successfully detached device vdb from instance daca1645-10d4-45e7-874a-b2972a494e6e from the persistent domain config.
Aug 26 16:37:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance daca1645-10d4-45e7-874a-b2972a494e6e from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:37:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:37:38 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:37:38 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:37:38 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:37:38 user nova-compute[73627]:   <serial>fc099332-184b-439e-8d5d-572771e03d0a</serial>
Aug 26 16:37:38 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:37:38 user nova-compute[73627]: </disk>
Aug 26 16:37:38 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG nova.network.neutron [req-dec7896f-f2ae-446e-bb01-d4b27c2b8e83 req-ce0234b9-c7e9-4bd0-ab18-09074deb0117 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updated VIF entry in instance network info cache for port 6757dac8-c193-43e9-88cd-c4ac4d551120. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG nova.network.neutron [req-dec7896f-f2ae-446e-bb01-d4b27c2b8e83 req-ce0234b9-c7e9-4bd0-ab18-09074deb0117 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updating instance_info_cache with network_info: [{"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dec7896f-f2ae-446e-bb01-d4b27c2b8e83 req-ce0234b9-c7e9-4bd0-ab18-09074deb0117 service nova] Releasing lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067859.3897111, daca1645-10d4-45e7-874a-b2972a494e6e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:37:39 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Successfully detached device vdb from instance daca1645-10d4-45e7-874a-b2972a494e6e from the live domain config.
Aug 26 16:37:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfbhpjrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:37:39 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e121b402-740c-40fb-9db1-4c6349816b7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee164dd-bbe4-4c82-a5a2-00e7110f8cb7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:37:39 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:39 user nova-compute[73627]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:37:39 user nova-compute[73627]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd (non-flash)
Aug 26 16:37:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a (non-flash)
Aug 26 16:37:39 user nova-compute[73627]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:39 user nova-compute[73627]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:37:39 user nova-compute[73627]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd (non-flash)
Aug 26 16:37:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3f6fd6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[683230b2-6bbc-424d-be58-5350dd20bfeb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9704e27a-5ba0-4ff8-a81b-dd405a8034db]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb78e7be-01db-4eaa-a672-72e4a0b991c4]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9166916e-f38d-45f9-bd32-be79800caf66]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c91ffa-5b43-4ded-b173-e8027ebba151]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfcb8ee-e4eb-425a-b1e1-036c21815e8d]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a, portal: 172.16.0.220,3260]
Aug 26 16:37:39 user nova-compute[73627]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a, portal: 172.16.0.220,3260] successful.
Aug 26 16:37:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc099332-184b-439e-8d5d-572771e03d0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece4968f-281e-4926-b5cf-b9a2f4abfbc8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] <== disconnect_volume: return (286ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:37:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:37:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-001b8a21-83c4-4656-980a-a45ad5cf781d req-d4bfb4b7-8bcb-4ba2-886a-79d62952311e service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-changed-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:37:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-001b8a21-83c4-4656-980a-a45ad5cf781d req-d4bfb4b7-8bcb-4ba2-886a-79d62952311e service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Refreshing instance network info cache due to event network-changed-6757dac8-c193-43e9-88cd-c4ac4d551120. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:37:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-001b8a21-83c4-4656-980a-a45ad5cf781d req-d4bfb4b7-8bcb-4ba2-886a-79d62952311e service nova] Acquiring lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:37:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-001b8a21-83c4-4656-980a-a45ad5cf781d req-d4bfb4b7-8bcb-4ba2-886a-79d62952311e service nova] Acquired lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:37:40 user nova-compute[73627]: DEBUG nova.network.neutron [req-001b8a21-83c4-4656-980a-a45ad5cf781d req-d4bfb4b7-8bcb-4ba2-886a-79d62952311e service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Refreshing network info cache for port 6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:37:40 user nova-compute[73627]: DEBUG nova.objects.instance [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'flavor' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:37:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d3a579fe-c330-4ae0-b4db-e3f847103be4 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.759s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:37:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:40 user nova-compute[73627]: DEBUG nova.network.neutron [req-001b8a21-83c4-4656-980a-a45ad5cf781d req-d4bfb4b7-8bcb-4ba2-886a-79d62952311e service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updated VIF entry in instance network info cache for port 6757dac8-c193-43e9-88cd-c4ac4d551120. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:37:40 user nova-compute[73627]: DEBUG nova.network.neutron [req-001b8a21-83c4-4656-980a-a45ad5cf781d req-d4bfb4b7-8bcb-4ba2-886a-79d62952311e service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updating instance_info_cache with network_info: [{"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:37:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-001b8a21-83c4-4656-980a-a45ad5cf781d req-d4bfb4b7-8bcb-4ba2-886a-79d62952311e service nova] Releasing lock "refresh_cache-daca1645-10d4-45e7-874a-b2972a494e6e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:37:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:37:59 user nova-compute[73627]: INFO nova.compute.manager [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Detaching volume be1bea19-8c95-459e-89f7-2c54bae9989f
Aug 26 16:37:59 user nova-compute[73627]: INFO nova.virt.block_device [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Attempting to driver detach volume be1bea19-8c95-459e-89f7-2c54bae9989f from mountpoint /dev/vdb
Aug 26 16:37:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Attempting to detach device vdb from instance 914c5004-52af-4826-914d-ca3d215cf040 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:37:59 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:37:59 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:37:59 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:37:59 user nova-compute[73627]:   <serial>be1bea19-8c95-459e-89f7-2c54bae9989f</serial>
Aug 26 16:37:59 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:37:59 user nova-compute[73627]: </disk>
Aug 26 16:37:59 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:37:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Successfully detached device vdb from instance 914c5004-52af-4826-914d-ca3d215cf040 from the persistent domain config.
Aug 26 16:37:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 914c5004-52af-4826-914d-ca3d215cf040 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:37:59 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:37:59 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:37:59 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:37:59 user nova-compute[73627]:   <serial>be1bea19-8c95-459e-89f7-2c54bae9989f</serial>
Aug 26 16:37:59 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:37:59 user nova-compute[73627]: </disk>
Aug 26 16:37:59 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067879.6050587, 914c5004-52af-4826-914d-ca3d215cf040 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 914c5004-52af-4826-914d-ca3d215cf040 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:37:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Successfully detached device vdb from instance 914c5004-52af-4826-914d-ca3d215cf040 from the live domain config.
Aug 26 16:37:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrJAouIl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:37:59 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1755be70-7aec-4dc7-8696-6c2ea6f562bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[50377687-a70b-4227-b710-77ec73972e93]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:59 user nova-compute[73627]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:37:59 user nova-compute[73627]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd (non-flash)
Aug 26 16:37:59 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f (non-flash)
Aug 26 16:37:59 user nova-compute[73627]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:37:59 user nova-compute[73627]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd54f721-1d58-4fdf-a77e-1fe583ab53fd (non-flash)
Aug 26 16:37:59 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3f01ea680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c522e2-8c74-4f47-a97f-634001132ad9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a068a988-7f94-4e50-97b7-0d1aa2ba1d5f]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85f18eb-aed1-49dc-896c-e44bc920b95f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cffb5a1-d66a-4d89-8cc8-d7cf0837edce]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ff4286-4ff1-438c-9f80-19a0c5c373c7]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d614638-5a9b-461b-b02e-31c313792680]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f, portal: 172.16.0.220,3260]
Aug 26 16:37:59 user nova-compute[73627]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f, portal: 172.16.0.220,3260] successful.
Aug 26 16:37:59 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1bea19-8c95-459e-89f7-2c54bae9989f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d973b3b1-97eb-4351-8501-85c1d5516e68]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] <== disconnect_volume: return (306ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:37:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:38:00 user nova-compute[73627]: DEBUG nova.objects.instance [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lazy-loading 'flavor' on Instance uuid 914c5004-52af-4826-914d-ca3d215cf040 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:38:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f099dadb-a5c9-4452-a507-c7c7cb28577f tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.953s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:38:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:38:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:38:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:38:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-5837b40e-107c-4f2e-9c46-508f90f49806 req-878ed97e-f5ee-4635-abcc-0739bb91292b service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-changed-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-5837b40e-107c-4f2e-9c46-508f90f49806 req-878ed97e-f5ee-4635-abcc-0739bb91292b service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Refreshing instance network info cache due to event network-changed-8437f747-1797-4480-9ad4-52e88581f6c1. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:38:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5837b40e-107c-4f2e-9c46-508f90f49806 req-878ed97e-f5ee-4635-abcc-0739bb91292b service nova] Acquiring lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:38:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5837b40e-107c-4f2e-9c46-508f90f49806 req-878ed97e-f5ee-4635-abcc-0739bb91292b service nova] Acquired lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:38:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-5837b40e-107c-4f2e-9c46-508f90f49806 req-878ed97e-f5ee-4635-abcc-0739bb91292b service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Refreshing network info cache for port 8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:38:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-5837b40e-107c-4f2e-9c46-508f90f49806 req-878ed97e-f5ee-4635-abcc-0739bb91292b service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updated VIF entry in instance network info cache for port 8437f747-1797-4480-9ad4-52e88581f6c1. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:38:05 user nova-compute[73627]: DEBUG nova.network.neutron [req-5837b40e-107c-4f2e-9c46-508f90f49806 req-878ed97e-f5ee-4635-abcc-0739bb91292b service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updating instance_info_cache with network_info: [{"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:38:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5837b40e-107c-4f2e-9c46-508f90f49806 req-878ed97e-f5ee-4635-abcc-0739bb91292b service nova] Releasing lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:38:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:38:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:38:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:09 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:38:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "98114285-9c1d-4ff4-9121-77bd1a798200" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:10 user nova-compute[73627]: INFO nova.compute.manager [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Shelving
Aug 26 16:38:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:11 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Instance destroyed successfully.
Aug 26 16:38:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-cfdb2144-515d-493c-9e67-c6da8e2e6662 req-3f96953f-8525-4b70-9de4-7cb52a141f29 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-vif-unplugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cfdb2144-515d-493c-9e67-c6da8e2e6662 req-3f96953f-8525-4b70-9de4-7cb52a141f29 service nova] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cfdb2144-515d-493c-9e67-c6da8e2e6662 req-3f96953f-8525-4b70-9de4-7cb52a141f29 service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cfdb2144-515d-493c-9e67-c6da8e2e6662 req-3f96953f-8525-4b70-9de4-7cb52a141f29 service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-cfdb2144-515d-493c-9e67-c6da8e2e6662 req-3f96953f-8525-4b70-9de4-7cb52a141f29 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] No waiting events found dispatching network-vif-unplugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:38:11 user nova-compute[73627]: WARNING nova.compute.manager [req-cfdb2144-515d-493c-9e67-c6da8e2e6662 req-3f96953f-8525-4b70-9de4-7cb52a141f29 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received unexpected event network-vif-unplugged-8437f747-1797-4480-9ad4-52e88581f6c1 for instance with vm_state active and task_state shelving.
Aug 26 16:38:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:12 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Beginning cold snapshot process
Aug 26 16:38:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:12 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:38:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk /opt/stack/data/nova/instances/snapshots/tmpc6lh4l16/a0fb0d972e4e439ab6f47b8bba7e41e7 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk /opt/stack/data/nova/instances/snapshots/tmpc6lh4l16/a0fb0d972e4e439ab6f47b8bba7e41e7" returned: 0 in 1.068s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Snapshot extracted, beginning image upload
Aug 26 16:38:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-a3f9f4e6-996c-41c7-a0f1-49065ba06274 req-80489e0f-0f74-4ded-acfe-c51491d12eba service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a3f9f4e6-996c-41c7-a0f1-49065ba06274 req-80489e0f-0f74-4ded-acfe-c51491d12eba service nova] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a3f9f4e6-996c-41c7-a0f1-49065ba06274 req-80489e0f-0f74-4ded-acfe-c51491d12eba service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a3f9f4e6-996c-41c7-a0f1-49065ba06274 req-80489e0f-0f74-4ded-acfe-c51491d12eba service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-a3f9f4e6-996c-41c7-a0f1-49065ba06274 req-80489e0f-0f74-4ded-acfe-c51491d12eba service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] No waiting events found dispatching network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:38:14 user nova-compute[73627]: WARNING nova.compute.manager [req-a3f9f4e6-996c-41c7-a0f1-49065ba06274 req-80489e0f-0f74-4ded-acfe-c51491d12eba service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received unexpected event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 16:38:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:38:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:38:15 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:38:15 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=7320MB free_disk=25.291423797607422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance daca1645-10d4-45e7-874a-b2972a494e6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 914c5004-52af-4826-914d-ca3d215cf040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b5277d78-3a96-4d79-8825-26d042254c12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8e049438-4a89-4bc9-bd98-397c8c699fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 98114285-9c1d-4ff4-9121-77bd1a798200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 11b98779-e085-4af6-a5eb-59350f4a4d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:38:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:16 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Snapshot image upload complete
Aug 26 16:38:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:38:16 user nova-compute[73627]: INFO nova.compute.manager [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Shelve offloading
Aug 26 16:38:16 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Instance destroyed successfully.
Aug 26 16:38:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:38:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:38:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquired lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:38:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:38:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:38:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:38:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:38:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:38:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:38:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:38:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG nova.network.neutron [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updating instance_info_cache with network_info: [{"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Releasing lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:38:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Instance destroyed successfully.
Aug 26 16:38:17 user nova-compute[73627]: DEBUG nova.objects.instance [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'resources' on Instance uuid 98114285-9c1d-4ff4-9121-77bd1a798200 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-233452645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-233452645',id=32,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0ddVKlODQpyHh4KT4LZnVXn94T1Lwdm0PnrfafPY1hWmK4SZJYuJRT2e+F5UcAOCxUPzvz/BqVEYfiayi4QRZCRWncJwCoDfzYVAWf8qI/e1XQvBI3Fbb4ZetPPf9gWA==',key_name='tempest-keypair-9464290',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-ln08v5k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member',shelved_at='2023-08-26T16:38:16.311255',shelved_host='user',shelved_image_id='d47ace34-7793-4ee7-96f5-0fcb655d18b1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:38:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=98114285-9c1d-4ff4-9121-77bd1a798200,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG os_vif [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8437f747-17, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-2eb5e15c-311a-4234-83b1-66da11e94b41 req-ce9c7312-9bb3-4b8a-9ea6-74b2a1ffc9a5 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-changed-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-2eb5e15c-311a-4234-83b1-66da11e94b41 req-ce9c7312-9bb3-4b8a-9ea6-74b2a1ffc9a5 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Refreshing instance network info cache due to event network-changed-8437f747-1797-4480-9ad4-52e88581f6c1. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2eb5e15c-311a-4234-83b1-66da11e94b41 req-ce9c7312-9bb3-4b8a-9ea6-74b2a1ffc9a5 service nova] Acquiring lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2eb5e15c-311a-4234-83b1-66da11e94b41 req-ce9c7312-9bb3-4b8a-9ea6-74b2a1ffc9a5 service nova] Acquired lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG nova.network.neutron [req-2eb5e15c-311a-4234-83b1-66da11e94b41 req-ce9c7312-9bb3-4b8a-9ea6-74b2a1ffc9a5 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Refreshing network info cache for port 8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:38:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:38:17 user nova-compute[73627]: INFO os_vif [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17')
Aug 26 16:38:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Deleting instance files /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200_del
Aug 26 16:38:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Deletion of /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200_del complete
Aug 26 16:38:18 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Deleted allocations for instance 98114285-9c1d-4ff4-9121-77bd1a798200
Aug 26 16:38:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG nova.objects.instance [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'numa_topology' on Instance uuid 98114285-9c1d-4ff4-9121-77bd1a798200 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG nova.objects.base [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Object Instance<98114285-9c1d-4ff4-9121-77bd1a798200> lazy-loaded attributes: resources,numa_topology {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG nova.network.neutron [req-2eb5e15c-311a-4234-83b1-66da11e94b41 req-ce9c7312-9bb3-4b8a-9ea6-74b2a1ffc9a5 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updated VIF entry in instance network info cache for port 8437f747-1797-4480-9ad4-52e88581f6c1. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG nova.network.neutron [req-2eb5e15c-311a-4234-83b1-66da11e94b41 req-ce9c7312-9bb3-4b8a-9ea6-74b2a1ffc9a5 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updating instance_info_cache with network_info: [{"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8437f747-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2eb5e15c-311a-4234-83b1-66da11e94b41 req-ce9c7312-9bb3-4b8a-9ea6-74b2a1ffc9a5 service nova] Releasing lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-83741e31-4e27-4c64-978c-5b402379c551 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "98114285-9c1d-4ff4-9121-77bd1a798200" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.720s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:38:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 16:38:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:24 user nova-compute[73627]: INFO nova.compute.manager [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Terminating instance
Aug 26 16:38:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-34763c21-6c44-48d3-a593-2caa33da579d req-3c970b2e-3023-4faa-a8c5-273b763651db service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-vif-unplugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-34763c21-6c44-48d3-a593-2caa33da579d req-3c970b2e-3023-4faa-a8c5-273b763651db service nova] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-34763c21-6c44-48d3-a593-2caa33da579d req-3c970b2e-3023-4faa-a8c5-273b763651db service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-34763c21-6c44-48d3-a593-2caa33da579d req-3c970b2e-3023-4faa-a8c5-273b763651db service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-34763c21-6c44-48d3-a593-2caa33da579d req-3c970b2e-3023-4faa-a8c5-273b763651db service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] No waiting events found dispatching network-vif-unplugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-34763c21-6c44-48d3-a593-2caa33da579d req-3c970b2e-3023-4faa-a8c5-273b763651db service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-vif-unplugged-e193c76c-8dac-420e-9749-9c42f62ad3cf for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:38:24 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Instance destroyed successfully.
Aug 26 16:38:24 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'resources' on Instance uuid b5277d78-3a96-4d79-8825-26d042254c12 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1120972842',display_name='tempest-ServerActionsTestOtherA-server-870118476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1120972842',id=29,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGEVaZilfejgzOVBO/Dl5oWhwyQx7yT0CQZLwHfV5uQSNiyESnSSBwifVOuHAIiHVCjFzc8FACGrVIdJFbzB7rWnkykjmcwfVvI05Tl83CL/v/O1MgJawrdf1YL0vZThg==',key_name='tempest-keypair-645263688',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:35:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-lbff6ir2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=b5277d78-3a96-4d79-8825-26d042254c12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "address": "fa:16:3e:cd:6e:eb", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape193c76c-8d", "ovs_interfaceid": "e193c76c-8dac-420e-9749-9c42f62ad3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG os_vif [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape193c76c-8d, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:24 user nova-compute[73627]: INFO os_vif [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6e:eb,bridge_name='br-int',has_traffic_filtering=True,id=e193c76c-8dac-420e-9749-9c42f62ad3cf,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape193c76c-8d')
Aug 26 16:38:24 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Deleting instance files /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12_del
Aug 26 16:38:24 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Deletion of /opt/stack/data/nova/instances/b5277d78-3a96-4d79-8825-26d042254c12_del complete
Aug 26 16:38:25 user nova-compute[73627]: INFO nova.compute.manager [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 16:38:25 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:38:25 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:38:25 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: b5277d78-3a96-4d79-8825-26d042254c12] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:38:26 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:38:26 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Took 1.45 seconds to deallocate network for instance.
Aug 26 16:38:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-1adc6f7b-2f8d-427a-8bef-314381410fd4 req-44f85e52-d3d8-4e4b-ae6b-65f15f1cebe0 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1adc6f7b-2f8d-427a-8bef-314381410fd4 req-44f85e52-d3d8-4e4b-ae6b-65f15f1cebe0 service nova] Acquiring lock "b5277d78-3a96-4d79-8825-26d042254c12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1adc6f7b-2f8d-427a-8bef-314381410fd4 req-44f85e52-d3d8-4e4b-ae6b-65f15f1cebe0 service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1adc6f7b-2f8d-427a-8bef-314381410fd4 req-44f85e52-d3d8-4e4b-ae6b-65f15f1cebe0 service nova] Lock "b5277d78-3a96-4d79-8825-26d042254c12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-1adc6f7b-2f8d-427a-8bef-314381410fd4 req-44f85e52-d3d8-4e4b-ae6b-65f15f1cebe0 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] No waiting events found dispatching network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:38:26 user nova-compute[73627]: WARNING nova.compute.manager [req-1adc6f7b-2f8d-427a-8bef-314381410fd4 req-44f85e52-d3d8-4e4b-ae6b-65f15f1cebe0 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received unexpected event network-vif-plugged-e193c76c-8dac-420e-9749-9c42f62ad3cf for instance with vm_state deleted and task_state None.
Aug 26 16:38:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-1adc6f7b-2f8d-427a-8bef-314381410fd4 req-44f85e52-d3d8-4e4b-ae6b-65f15f1cebe0 service nova] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Received event network-vif-deleted-e193c76c-8dac-420e-9749-9c42f62ad3cf {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:26 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067891.6598737, 98114285-9c1d-4ff4-9121-77bd1a798200 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:38:26 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] VM Stopped (Lifecycle Event)
Aug 26 16:38:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-28409eeb-fd12-4c40-905e-24dcde147f18 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:38:26 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:38:26 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:38:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:26 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Deleted allocations for instance b5277d78-3a96-4d79-8825-26d042254c12
Aug 26 16:38:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6fcaa8-3e22-4d47-a3b4-3e6c2906b6fb tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "b5277d78-3a96-4d79-8825-26d042254c12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.861s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:29 user nova-compute[73627]: INFO nova.compute.manager [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Terminating instance
Aug 26 16:38:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-6a002699-34bb-4beb-a31a-b3799b8dfc16 req-9bc9e3c3-8643-4b70-b8de-ac5aefde2f6a service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-unplugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6a002699-34bb-4beb-a31a-b3799b8dfc16 req-9bc9e3c3-8643-4b70-b8de-ac5aefde2f6a service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6a002699-34bb-4beb-a31a-b3799b8dfc16 req-9bc9e3c3-8643-4b70-b8de-ac5aefde2f6a service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6a002699-34bb-4beb-a31a-b3799b8dfc16 req-9bc9e3c3-8643-4b70-b8de-ac5aefde2f6a service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-6a002699-34bb-4beb-a31a-b3799b8dfc16 req-9bc9e3c3-8643-4b70-b8de-ac5aefde2f6a service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-unplugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-6a002699-34bb-4beb-a31a-b3799b8dfc16 req-9bc9e3c3-8643-4b70-b8de-ac5aefde2f6a service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-unplugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:30 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Instance destroyed successfully.
Aug 26 16:38:30 user nova-compute[73627]: DEBUG nova.objects.instance [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'resources' on Instance uuid daca1645-10d4-45e7-874a-b2972a494e6e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:38:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:31:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1675444985',display_name='tempest-ServerRescueNegativeTestJSON-server-1675444985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1675444985',id=27,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9oNjx+q/f0Zsfa9d+owmTwOfPxnAFIujBDOcAHpLpFBrMTb/9AuaTtdHxoyI837Zw0tIQiWWvz1WlumzmI3vcf2OAhWTK61Gwy/QsE2gdYqKqsvpsyXP7S8DW5XQHJNw==',key_name='tempest-keypair-801950324',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:34:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-0j9wi7yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:35:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acdf029015a64f89aa51e6559e0f962c',uuid=daca1645-10d4-45e7-874a-b2972a494e6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:38:30 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "6757dac8-c193-43e9-88cd-c4ac4d551120", "address": "fa:16:3e:3c:33:56", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6757dac8-c1", "ovs_interfaceid": "6757dac8-c193-43e9-88cd-c4ac4d551120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:38:30 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:33:56,bridge_name='br-int',has_traffic_filtering=True,id=6757dac8-c193-43e9-88cd-c4ac4d551120,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6757dac8-c1') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:38:30 user nova-compute[73627]: DEBUG os_vif [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:33:56,bridge_name='br-int',has_traffic_filtering=True,id=6757dac8-c193-43e9-88cd-c4ac4d551120,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6757dac8-c1') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:38:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6757dac8-c1, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:38:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:38:30 user nova-compute[73627]: INFO os_vif [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:33:56,bridge_name='br-int',has_traffic_filtering=True,id=6757dac8-c193-43e9-88cd-c4ac4d551120,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6757dac8-c1')
Aug 26 16:38:30 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Deleting instance files /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e_del
Aug 26 16:38:30 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Deletion of /opt/stack/data/nova/instances/daca1645-10d4-45e7-874a-b2972a494e6e_del complete
Aug 26 16:38:30 user nova-compute[73627]: INFO nova.compute.manager [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 16:38:30 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:38:30 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:38:30 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:38:31 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:38:31 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Took 1.01 seconds to deallocate network for instance.
Aug 26 16:38:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-584103b4-e7f1-4d87-92f0-b9378e5e5040 req-ae9513e7-14ea-48cc-8097-2d2951a00b20 service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-deleted-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:31 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:38:31 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:38:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:31 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Deleted allocations for instance daca1645-10d4-45e7-874a-b2972a494e6e
Aug 26 16:38:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5392c842-5652-4a54-bc84-3295e155d6b7 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "daca1645-10d4-45e7-874a-b2972a494e6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.390s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-00f823ea-784c-4ddb-802c-d2cb4b88242d req-a541b706-a754-423f-a6eb-a7d6fd6d7eea service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-00f823ea-784c-4ddb-802c-d2cb4b88242d req-a541b706-a754-423f-a6eb-a7d6fd6d7eea service nova] Acquiring lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-00f823ea-784c-4ddb-802c-d2cb4b88242d req-a541b706-a754-423f-a6eb-a7d6fd6d7eea service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-00f823ea-784c-4ddb-802c-d2cb4b88242d req-a541b706-a754-423f-a6eb-a7d6fd6d7eea service nova] Lock "daca1645-10d4-45e7-874a-b2972a494e6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-00f823ea-784c-4ddb-802c-d2cb4b88242d req-a541b706-a754-423f-a6eb-a7d6fd6d7eea service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] No waiting events found dispatching network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:38:31 user nova-compute[73627]: WARNING nova.compute.manager [req-00f823ea-784c-4ddb-802c-d2cb4b88242d req-a541b706-a754-423f-a6eb-a7d6fd6d7eea service nova] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Received unexpected event network-vif-plugged-6757dac8-c193-43e9-88cd-c4ac4d551120 for instance with vm_state deleted and task_state None.
Aug 26 16:38:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:39 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067904.9353137, b5277d78-3a96-4d79-8825-26d042254c12 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:38:39 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: b5277d78-3a96-4d79-8825-26d042254c12] VM Stopped (Lifecycle Event)
Aug 26 16:38:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-095a2fa7-887a-474f-835f-3abfe572dce0 None None] [instance: b5277d78-3a96-4d79-8825-26d042254c12] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:38:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:45 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067910.0132718, daca1645-10d4-45e7-874a-b2972a494e6e => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:38:45 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] VM Stopped (Lifecycle Event)
Aug 26 16:38:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-37295e6d-2d1b-4563-aa4d-7b4a247b8cf0 None None] [instance: daca1645-10d4-45e7-874a-b2972a494e6e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:38:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:38:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:49 user nova-compute[73627]: INFO nova.compute.manager [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Terminating instance
Aug 26 16:38:49 user nova-compute[73627]: DEBUG nova.compute.manager [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:38:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-a5aa972f-8b04-4774-95c3-d56278f36d64 req-4aec7703-d148-4d96-b1eb-758a69c5f43c service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Received event network-vif-unplugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a5aa972f-8b04-4774-95c3-d56278f36d64 req-4aec7703-d148-4d96-b1eb-758a69c5f43c service nova] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a5aa972f-8b04-4774-95c3-d56278f36d64 req-4aec7703-d148-4d96-b1eb-758a69c5f43c service nova] Lock "914c5004-52af-4826-914d-ca3d215cf040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a5aa972f-8b04-4774-95c3-d56278f36d64 req-4aec7703-d148-4d96-b1eb-758a69c5f43c service nova] Lock "914c5004-52af-4826-914d-ca3d215cf040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-a5aa972f-8b04-4774-95c3-d56278f36d64 req-4aec7703-d148-4d96-b1eb-758a69c5f43c service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] No waiting events found dispatching network-vif-unplugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-a5aa972f-8b04-4774-95c3-d56278f36d64 req-4aec7703-d148-4d96-b1eb-758a69c5f43c service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Received event network-vif-unplugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:38:50 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Instance destroyed successfully.
Aug 26 16:38:50 user nova-compute[73627]: DEBUG nova.objects.instance [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lazy-loading 'resources' on Instance uuid 914c5004-52af-4826-914d-ca3d215cf040 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-378428966',display_name='tempest-TestServerVolumeAttachmentScenario-server-378428966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-378428966',id=28,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWKxC4V7JWxQf9iBL2XdLfz4SGoiXmxFQmGgXsCZsIweqWEaHR37Uvd3m37Y0HczC5CQ/WLPk3vOXywdrln+yZ1DzWPbLFGOFahVgEMXG+ImUZZUUa3yln11fkza9iTvQ==',key_name='tempest-keypair-798834650',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:32:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae57d24e815640678acc75e60a1d5412',ramdisk_id='',reservation_id='r-0006gh3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1145809252',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1145809252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbd015cd3d2c4518817f1e78f70afc8c',uuid=914c5004-52af-4826-914d-ca3d215cf040,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "address": "fa:16:3e:14:2f:bb", "network": {"id": "6c49bdb2-f5c9-4902-9d6e-9bcb5860a270", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1479283516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae57d24e815640678acc75e60a1d5412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7bfe-28", "ovs_interfaceid": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Converting VIF {"id": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "address": "fa:16:3e:14:2f:bb", "network": {"id": "6c49bdb2-f5c9-4902-9d6e-9bcb5860a270", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1479283516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae57d24e815640678acc75e60a1d5412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dd7bfe-28", "ovs_interfaceid": "60dd7bfe-2839-4ce9-ba5c-df63337f418b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=60dd7bfe-2839-4ce9-ba5c-df63337f418b,network=Network(6c49bdb2-f5c9-4902-9d6e-9bcb5860a270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7bfe-28') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG os_vif [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=60dd7bfe-2839-4ce9-ba5c-df63337f418b,network=Network(6c49bdb2-f5c9-4902-9d6e-9bcb5860a270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7bfe-28') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60dd7bfe-28, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:38:50 user nova-compute[73627]: INFO os_vif [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=60dd7bfe-2839-4ce9-ba5c-df63337f418b,network=Network(6c49bdb2-f5c9-4902-9d6e-9bcb5860a270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dd7bfe-28')
Aug 26 16:38:50 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Deleting instance files /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040_del
Aug 26 16:38:50 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Deletion of /opt/stack/data/nova/instances/914c5004-52af-4826-914d-ca3d215cf040_del complete
Aug 26 16:38:50 user nova-compute[73627]: INFO nova.compute.manager [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 16:38:50 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:38:50 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 914c5004-52af-4826-914d-ca3d215cf040] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:38:52 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:38:52 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Took 1.47 seconds to deallocate network for instance.
Aug 26 16:38:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:52 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:38:52 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:38:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:52 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Deleted allocations for instance 914c5004-52af-4826-914d-ca3d215cf040
Aug 26 16:38:52 user nova-compute[73627]: DEBUG nova.compute.manager [req-7ba82c9d-85a8-47db-8174-79c7eb5c985e req-1f1d23d3-b48b-4c0b-ad90-df1d6d5cc6e1 service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Received event network-vif-plugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ba82c9d-85a8-47db-8174-79c7eb5c985e req-1f1d23d3-b48b-4c0b-ad90-df1d6d5cc6e1 service nova] Acquiring lock "914c5004-52af-4826-914d-ca3d215cf040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:38:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ba82c9d-85a8-47db-8174-79c7eb5c985e req-1f1d23d3-b48b-4c0b-ad90-df1d6d5cc6e1 service nova] Lock "914c5004-52af-4826-914d-ca3d215cf040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:38:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ba82c9d-85a8-47db-8174-79c7eb5c985e req-1f1d23d3-b48b-4c0b-ad90-df1d6d5cc6e1 service nova] Lock "914c5004-52af-4826-914d-ca3d215cf040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:52 user nova-compute[73627]: DEBUG nova.compute.manager [req-7ba82c9d-85a8-47db-8174-79c7eb5c985e req-1f1d23d3-b48b-4c0b-ad90-df1d6d5cc6e1 service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] No waiting events found dispatching network-vif-plugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:38:52 user nova-compute[73627]: WARNING nova.compute.manager [req-7ba82c9d-85a8-47db-8174-79c7eb5c985e req-1f1d23d3-b48b-4c0b-ad90-df1d6d5cc6e1 service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Received unexpected event network-vif-plugged-60dd7bfe-2839-4ce9-ba5c-df63337f418b for instance with vm_state deleted and task_state None.
Aug 26 16:38:52 user nova-compute[73627]: DEBUG nova.compute.manager [req-7ba82c9d-85a8-47db-8174-79c7eb5c985e req-1f1d23d3-b48b-4c0b-ad90-df1d6d5cc6e1 service nova] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Received event network-vif-deleted-60dd7bfe-2839-4ce9-ba5c-df63337f418b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:52 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-577adb43-32c7-469d-871e-deaa5140f4d7 tempest-TestServerVolumeAttachmentScenario-1145809252 tempest-TestServerVolumeAttachmentScenario-1145809252-project-member] Lock "914c5004-52af-4826-914d-ca3d215cf040" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.902s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:38:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:38:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-8fd4fbd6-6e18-481f-97da-15c54c42e077 req-b8baadfa-01e0-48d5-a0fe-3e62660c2cc6 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-changed-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:38:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-8fd4fbd6-6e18-481f-97da-15c54c42e077 req-b8baadfa-01e0-48d5-a0fe-3e62660c2cc6 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Refreshing instance network info cache due to event network-changed-9f3a452b-b466-40bd-809e-38d61cd3ba5e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:38:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8fd4fbd6-6e18-481f-97da-15c54c42e077 req-b8baadfa-01e0-48d5-a0fe-3e62660c2cc6 service nova] Acquiring lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:38:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8fd4fbd6-6e18-481f-97da-15c54c42e077 req-b8baadfa-01e0-48d5-a0fe-3e62660c2cc6 service nova] Acquired lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:38:59 user nova-compute[73627]: DEBUG nova.network.neutron [req-8fd4fbd6-6e18-481f-97da-15c54c42e077 req-b8baadfa-01e0-48d5-a0fe-3e62660c2cc6 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Refreshing network info cache for port 9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:39:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-8fd4fbd6-6e18-481f-97da-15c54c42e077 req-b8baadfa-01e0-48d5-a0fe-3e62660c2cc6 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updated VIF entry in instance network info cache for port 9f3a452b-b466-40bd-809e-38d61cd3ba5e. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:39:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-8fd4fbd6-6e18-481f-97da-15c54c42e077 req-b8baadfa-01e0-48d5-a0fe-3e62660c2cc6 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updating instance_info_cache with network_info: [{"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:39:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8fd4fbd6-6e18-481f-97da-15c54c42e077 req-b8baadfa-01e0-48d5-a0fe-3e62660c2cc6 service nova] Releasing lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:39:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:01 user nova-compute[73627]: INFO nova.compute.manager [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Detaching volume 363ef156-d623-44d4-a815-6526e108a262
Aug 26 16:39:01 user nova-compute[73627]: INFO nova.virt.block_device [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Attempting to driver detach volume 363ef156-d623-44d4-a815-6526e108a262 from mountpoint /dev/vdb
Aug 26 16:39:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Attempting to detach device vdb from instance 8e049438-4a89-4bc9-bd98-397c8c699fc9 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:39:01 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:39:01 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:39:01 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:39:01 user nova-compute[73627]:   <serial>363ef156-d623-44d4-a815-6526e108a262</serial>
Aug 26 16:39:01 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 16:39:01 user nova-compute[73627]: </disk>
Aug 26 16:39:01 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:39:01 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Successfully detached device vdb from instance 8e049438-4a89-4bc9-bd98-397c8c699fc9 from the persistent domain config.
Aug 26 16:39:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e049438-4a89-4bc9-bd98-397c8c699fc9 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:39:01 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:39:01 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:39:01 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:39:01 user nova-compute[73627]:   <serial>363ef156-d623-44d4-a815-6526e108a262</serial>
Aug 26 16:39:01 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 16:39:01 user nova-compute[73627]: </disk>
Aug 26 16:39:01 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067941.7711654, 8e049438-4a89-4bc9-bd98-397c8c699fc9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:39:01 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Successfully detached device vdb from instance 8e049438-4a89-4bc9-bd98-397c8c699fc9 from the live domain config.
Aug 26 16:39:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJUNMurS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:39:01 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3b2595-d851-46e1-af2f-1dd9e875477e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c7e370-a08f-4054-8ccd-0017a5be5a8e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:39:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 (non-flash)
Aug 26 16:39:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d04b0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262'): ({'sdd'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Removing single pathed devices sdd {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0551e0-f5cb-4062-9e40-ba9895ec5d4c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8104d27f-cdde-41e6-ad44-8c6443581f88]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Flushing IO for device /dev/sdd {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1395369-aac4-43f1-a726-0b12720c5155]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-9e5359cb-c5fb-4e72-afab-d5e9bafb4637 req-39c4ba21-22e6-4c1d-88c5-fcc988a8f1a8 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-changed-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-9e5359cb-c5fb-4e72-afab-d5e9bafb4637 req-39c4ba21-22e6-4c1d-88c5-fcc988a8f1a8 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Refreshing instance network info cache due to event network-changed-9f3a452b-b466-40bd-809e-38d61cd3ba5e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e5359cb-c5fb-4e72-afab-d5e9bafb4637 req-39c4ba21-22e6-4c1d-88c5-fcc988a8f1a8 service nova] Acquiring lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e5359cb-c5fb-4e72-afab-d5e9bafb4637 req-39c4ba21-22e6-4c1d-88c5-fcc988a8f1a8 service nova] Acquired lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-9e5359cb-c5fb-4e72-afab-d5e9bafb4637 req-39c4ba21-22e6-4c1d-88c5-fcc988a8f1a8 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Refreshing network info cache for port 9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e0b98c-5bf6-46f3-9476-4f40529d58ba]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:39:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a4682c-d27c-4578-9efc-e276eda83a7b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0388e339-3257-41c0-99ff-db3274ce7f8f]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260]
Aug 26 16:39:02 user nova-compute[73627]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262, portal: 172.16.0.220,3260] successful.
Aug 26 16:39:02 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363ef156-d623-44d4-a815-6526e108a262 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8c1925-8fd0-4e47-b059-7ad3dfc20fa2]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] <== disconnect_volume: return (329ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG nova.network.neutron [req-9e5359cb-c5fb-4e72-afab-d5e9bafb4637 req-39c4ba21-22e6-4c1d-88c5-fcc988a8f1a8 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updated VIF entry in instance network info cache for port 9f3a452b-b466-40bd-809e-38d61cd3ba5e. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG nova.network.neutron [req-9e5359cb-c5fb-4e72-afab-d5e9bafb4637 req-39c4ba21-22e6-4c1d-88c5-fcc988a8f1a8 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updating instance_info_cache with network_info: [{"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:39:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9e5359cb-c5fb-4e72-afab-d5e9bafb4637 req-39c4ba21-22e6-4c1d-88c5-fcc988a8f1a8 service nova] Releasing lock "refresh_cache-8e049438-4a89-4bc9-bd98-397c8c699fc9" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:39:03 user nova-compute[73627]: DEBUG nova.objects.instance [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'flavor' on Instance uuid 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:39:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-26cee76e-3114-4785-a05d-c541fa6dd167 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.430s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-6da802ac-5387-47c3-833a-1e550ceaef6a req-81fb0737-bbd8-4e53-8cac-a04cf75847fe service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Received event network-changed-766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-6da802ac-5387-47c3-833a-1e550ceaef6a req-81fb0737-bbd8-4e53-8cac-a04cf75847fe service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Refreshing instance network info cache due to event network-changed-766c5422-05f4-4eca-96c7-c646c45a5fd1. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:39:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6da802ac-5387-47c3-833a-1e550ceaef6a req-81fb0737-bbd8-4e53-8cac-a04cf75847fe service nova] Acquiring lock "refresh_cache-11b98779-e085-4af6-a5eb-59350f4a4d52" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:39:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6da802ac-5387-47c3-833a-1e550ceaef6a req-81fb0737-bbd8-4e53-8cac-a04cf75847fe service nova] Acquired lock "refresh_cache-11b98779-e085-4af6-a5eb-59350f4a4d52" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:39:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-6da802ac-5387-47c3-833a-1e550ceaef6a req-81fb0737-bbd8-4e53-8cac-a04cf75847fe service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Refreshing network info cache for port 766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:39:05 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067930.526363, 914c5004-52af-4826-914d-ca3d215cf040 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:39:05 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 914c5004-52af-4826-914d-ca3d215cf040] VM Stopped (Lifecycle Event)
Aug 26 16:39:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-96085026-b5cd-4332-b8bd-3ba72a7d8d99 None None] [instance: 914c5004-52af-4826-914d-ca3d215cf040] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:39:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:06 user nova-compute[73627]: DEBUG nova.network.neutron [req-6da802ac-5387-47c3-833a-1e550ceaef6a req-81fb0737-bbd8-4e53-8cac-a04cf75847fe service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Updated VIF entry in instance network info cache for port 766c5422-05f4-4eca-96c7-c646c45a5fd1. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:39:06 user nova-compute[73627]: DEBUG nova.network.neutron [req-6da802ac-5387-47c3-833a-1e550ceaef6a req-81fb0737-bbd8-4e53-8cac-a04cf75847fe service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Updating instance_info_cache with network_info: [{"id": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "address": "fa:16:3e:71:b0:94", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c5422-05", "ovs_interfaceid": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:39:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6da802ac-5387-47c3-833a-1e550ceaef6a req-81fb0737-bbd8-4e53-8cac-a04cf75847fe service nova] Releasing lock "refresh_cache-11b98779-e085-4af6-a5eb-59350f4a4d52" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:39:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG nova.objects.instance [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 11b98779-e085-4af6-a5eb-59350f4a4d52 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:10 user nova-compute[73627]: INFO nova.compute.manager [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Attaching volume 2429419e-8a7a-46fc-9423-89a17a79551f to /dev/vdb
Aug 26 16:39:10 user nova-compute[73627]: DEBUG os_brick.utils [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6761425a-767d-40bc-83b6-7d00fc8e1142]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[71069ca6-a514-46d6-ac6f-be6e53051e13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[546ff120-21f4-4826-ab9e-0bd2518b9852]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bcbcbb-b19a-49e0-9568-75b0c0d8346f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:39:10 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[761fa44f-0891-4131-ac9e-0beb09c967c3]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG os_brick.utils [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Updating existing volume attachment record: a908f927-b167-4da3-9779-8819c85dfb50 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:14 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:39:14 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=7924MB free_disk=25.3394775390625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance a6f68ea4-789d-4456-a82d-d067384b566b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 8e049438-4a89-4bc9-bd98-397c8c699fc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 11b98779-e085-4af6-a5eb-59350f4a4d52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing inventories for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating ProviderTree inventory for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating inventory in ProviderTree for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing aggregate associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, aggregates: None {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing trait associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:39:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.746s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:18 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:39:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:39:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:39:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:39:18 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:39:18 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:39:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updating instance_info_cache with network_info: [{"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:39:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-6907d670-3efe-473c-b03c-eb26c4b7ef4e" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:39:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:39:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:39:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:21 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:21 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73627) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] There are 0 instances to clean {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELnJxeub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:39:22 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:39:22 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:39:22 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66c4d3e-aa0b-46c7-a289-e7647c6caa0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:39:22 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e8fdc9-498d-4524-bee6-6911f66afd8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f] added
Aug 26 16:39:22 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac45590-4b5d-4a70-bdd2-5eb6b17d73ce]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[049e8ec1-a27c-4308-8d6d-7676becac78c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELnJxeub {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELnJxeub" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d1edcd-9867-4ff1-8613-38ee235784d1]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELnJxeub'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[15236f52-e9c2-4e27-bc76-a3ed3341b9fd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[160c1fe9-4e86-4a94-af3b-faaf2168a3b3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:39:22 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:39:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:39:22 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:39:22 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 16:39:22 user nova-compute[73627]: 
Aug 26 16:39:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddda1054-7b02-4d7c-8519-52fd27fc0b31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f, portal: 172.16.0.220,3260]
Aug 26 16:39:23 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f, portal: 172.16.0.220,3260] successful.
Aug 26 16:39:23 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cacfef-7c3a-4a77-8804-4a0e295f5d1e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[763245cf-ae9c-473b-a010-30ac085b8a61]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)
Aug 26 16:39:23 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)
Aug 26 16:39:23 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[404df370-e170-4dd0-9ad9-d2911af38182]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:23 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:39:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELnJxeub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:39:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:39:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23864373733366635', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:39:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864373733366635', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:39:24 user nova-compute[73627]: DEBUG nova.objects.instance [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 11b98779-e085-4af6-a5eb-59350f4a4d52 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:39:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:39:24 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:39:24 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:39:24 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:39:24 user nova-compute[73627]:   <serial>2429419e-8a7a-46fc-9423-89a17a79551f</serial>
Aug 26 16:39:24 user nova-compute[73627]: </disk>
Aug 26 16:39:24 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:39:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:39:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:39:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No VIF found with MAC fa:16:3e:71:b0:94, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:39:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f10aa858-cfce-4f5b-8e5c-727b4db92d09 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.395s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid a6f68ea4-789d-4456-a82d-d067384b566b {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid c3901966-61e2-4be6-bb8f-bbc449c35b78 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 11b98779-e085-4af6-a5eb-59350f4a4d52 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "a6f68ea4-789d-4456-a82d-d067384b566b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "c3901966-61e2-4be6-bb8f-bbc449c35b78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "a6f68ea4-789d-4456-a82d-d067384b566b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Acquiring lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:39:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:29 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:39:29 user nova-compute[73627]: INFO nova.compute.claims [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Claim successful on node user
Aug 26 16:39:29 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:39:29 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:39:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:39:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:39:29 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:39:29 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:39:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:39:30 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Creating image(s)
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Acquiring lock "/opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "/opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "/opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG nova.policy [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e69ce035b143416e9fd443d8a0b88a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa43aded4a47faa2aeaefdb17a76bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.226s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk 1073741824" returned: 0 in 0.050s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Successfully created port: 3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Cannot resize image /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Ensure instance console log exists: /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Successfully updated port: 3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Acquiring lock "refresh_cache-3793d67f-b6a0-4eba-8f26-8358e30f12d6" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Acquired lock "refresh_cache-3793d67f-b6a0-4eba-8f26-8358e30f12d6" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.compute.manager [req-a7ef5cbf-9103-4134-9463-6569322e576c req-d821974f-4779-4650-9294-528f98399845 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Received event network-changed-3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.compute.manager [req-a7ef5cbf-9103-4134-9463-6569322e576c req-d821974f-4779-4650-9294-528f98399845 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Refreshing instance network info cache due to event network-changed-3fbd1e00-7723-461b-ab12-a26d6d5985cb. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7ef5cbf-9103-4134-9463-6569322e576c req-d821974f-4779-4650-9294-528f98399845 service nova] Acquiring lock "refresh_cache-3793d67f-b6a0-4eba-8f26-8358e30f12d6" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Updating instance_info_cache with network_info: [{"id": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "address": "fa:16:3e:43:55:bb", "network": {"id": "65db01d6-9f50-44a8-a81d-09c4a4eeac15", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a7c6cc558f914e288686b7d529eb93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbd1e00-77", "ovs_interfaceid": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Releasing lock "refresh_cache-3793d67f-b6a0-4eba-8f26-8358e30f12d6" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Instance network_info: |[{"id": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "address": "fa:16:3e:43:55:bb", "network": {"id": "65db01d6-9f50-44a8-a81d-09c4a4eeac15", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a7c6cc558f914e288686b7d529eb93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbd1e00-77", "ovs_interfaceid": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7ef5cbf-9103-4134-9463-6569322e576c req-d821974f-4779-4650-9294-528f98399845 service nova] Acquired lock "refresh_cache-3793d67f-b6a0-4eba-8f26-8358e30f12d6" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-a7ef5cbf-9103-4134-9463-6569322e576c req-d821974f-4779-4650-9294-528f98399845 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Refreshing network info cache for port 3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Start _get_guest_xml network_info=[{"id": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "address": "fa:16:3e:43:55:bb", "network": {"id": "65db01d6-9f50-44a8-a81d-09c4a4eeac15", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a7c6cc558f914e288686b7d529eb93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbd1e00-77", "ovs_interfaceid": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:39:32 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:39:32 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:39:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-604323559',display_name='tempest-VolumesNegativeTest-instance-604323559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-604323559',id=34,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62aa43aded4a47faa2aeaefdb17a76bd',ramdisk_id='',reservation_id='r-ht7esidh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1562346038',owner_user_name='tempest-VolumesNegativeTest-1562346038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:39:30Z,user_data=None,user_id='e69ce035b143416e9fd443d8a0b88a04',uuid=3793d67f-b6a0-4eba-8f26-8358e30f12d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "address": "fa:16:3e:43:55:bb", "network": {"id": "65db01d6-9f50-44a8-a81d-09c4a4eeac15", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a7c6cc558f914e288686b7d529eb93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbd1e00-77", "ovs_interfaceid": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Converting VIF {"id": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "address": "fa:16:3e:43:55:bb", "network": {"id": "65db01d6-9f50-44a8-a81d-09c4a4eeac15", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a7c6cc558f914e288686b7d529eb93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbd1e00-77", "ovs_interfaceid": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=3fbd1e00-7723-461b-ab12-a26d6d5985cb,network=Network(65db01d6-9f50-44a8-a81d-09c4a4eeac15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbd1e00-77') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lazy-loading 'pci_devices' on Instance uuid 3793d67f-b6a0-4eba-8f26-8358e30f12d6 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:39:32 user nova-compute[73627]:   <uuid>3793d67f-b6a0-4eba-8f26-8358e30f12d6</uuid>
Aug 26 16:39:32 user nova-compute[73627]:   <name>instance-00000022</name>
Aug 26 16:39:32 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:39:32 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:39:32 user nova-compute[73627]:   <metadata>
Aug 26 16:39:32 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:39:32 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:39:32 user nova-compute[73627]:       <nova:name>tempest-VolumesNegativeTest-instance-604323559</nova:name>
Aug 26 16:39:32 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:39:32</nova:creationTime>
Aug 26 16:39:32 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:39:32 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:39:32 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:39:32 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:39:32 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:39:32 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:39:32 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:39:32 user nova-compute[73627]:       <nova:owner>
Aug 26 16:39:32 user nova-compute[73627]:         <nova:user uuid="e69ce035b143416e9fd443d8a0b88a04">tempest-VolumesNegativeTest-1562346038-project-member</nova:user>
Aug 26 16:39:32 user nova-compute[73627]:         <nova:project uuid="62aa43aded4a47faa2aeaefdb17a76bd">tempest-VolumesNegativeTest-1562346038</nova:project>
Aug 26 16:39:32 user nova-compute[73627]:       </nova:owner>
Aug 26 16:39:32 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:39:32 user nova-compute[73627]:       <nova:ports>
Aug 26 16:39:32 user nova-compute[73627]:         <nova:port uuid="3fbd1e00-7723-461b-ab12-a26d6d5985cb">
Aug 26 16:39:32 user nova-compute[73627]:           <nova:ip type="fixed" address="192.168.233.162" ipVersion="4"/>
Aug 26 16:39:32 user nova-compute[73627]:         </nova:port>
Aug 26 16:39:32 user nova-compute[73627]:       </nova:ports>
Aug 26 16:39:32 user nova-compute[73627]:     </nova:instance>
Aug 26 16:39:32 user nova-compute[73627]:   </metadata>
Aug 26 16:39:32 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:39:32 user nova-compute[73627]:     <system>
Aug 26 16:39:32 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:39:32 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:39:32 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:39:32 user nova-compute[73627]:       <entry name="serial">3793d67f-b6a0-4eba-8f26-8358e30f12d6</entry>
Aug 26 16:39:32 user nova-compute[73627]:       <entry name="uuid">3793d67f-b6a0-4eba-8f26-8358e30f12d6</entry>
Aug 26 16:39:32 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:39:32 user nova-compute[73627]:     </system>
Aug 26 16:39:32 user nova-compute[73627]:   </sysinfo>
Aug 26 16:39:32 user nova-compute[73627]:   <os>
Aug 26 16:39:32 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:39:32 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:39:32 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:39:32 user nova-compute[73627]:   </os>
Aug 26 16:39:32 user nova-compute[73627]:   <features>
Aug 26 16:39:32 user nova-compute[73627]:     <acpi/>
Aug 26 16:39:32 user nova-compute[73627]:     <apic/>
Aug 26 16:39:32 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:39:32 user nova-compute[73627]:   </features>
Aug 26 16:39:32 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:39:32 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:39:32 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:39:32 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:39:32 user nova-compute[73627]:   </clock>
Aug 26 16:39:32 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:39:32 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:39:32 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:39:32 user nova-compute[73627]:   </cpu>
Aug 26 16:39:32 user nova-compute[73627]:   <devices>
Aug 26 16:39:32 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:39:32 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:39:32 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk"/>
Aug 26 16:39:32 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:39:32 user nova-compute[73627]:     </disk>
Aug 26 16:39:32 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:39:32 user nova-compute[73627]:       <mac address="fa:16:3e:43:55:bb"/>
Aug 26 16:39:32 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:39:32 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:39:32 user nova-compute[73627]:       <target dev="tap3fbd1e00-77"/>
Aug 26 16:39:32 user nova-compute[73627]:     </interface>
Aug 26 16:39:32 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:39:32 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/console.log" append="off"/>
Aug 26 16:39:32 user nova-compute[73627]:     </serial>
Aug 26 16:39:32 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:39:32 user nova-compute[73627]:     <video>
Aug 26 16:39:32 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:39:32 user nova-compute[73627]:     </video>
Aug 26 16:39:32 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:39:32 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:39:32 user nova-compute[73627]:     </rng>
Aug 26 16:39:32 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:39:32 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:39:32 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:39:32 user nova-compute[73627]:     </memballoon>
Aug 26 16:39:32 user nova-compute[73627]:   </devices>
Aug 26 16:39:32 user nova-compute[73627]: </domain>
Aug 26 16:39:32 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:39:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-604323559',display_name='tempest-VolumesNegativeTest-instance-604323559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-604323559',id=34,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62aa43aded4a47faa2aeaefdb17a76bd',ramdisk_id='',reservation_id='r-ht7esidh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1562346038',owner_user_name='tempest-VolumesNegativeTest-1562346038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:39:30Z,user_data=None,user_id='e69ce035b143416e9fd443d8a0b88a04',uuid=3793d67f-b6a0-4eba-8f26-8358e30f12d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "address": "fa:16:3e:43:55:bb", "network": {"id": "65db01d6-9f50-44a8-a81d-09c4a4eeac15", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a7c6cc558f914e288686b7d529eb93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbd1e00-77", "ovs_interfaceid": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Converting VIF {"id": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "address": "fa:16:3e:43:55:bb", "network": {"id": "65db01d6-9f50-44a8-a81d-09c4a4eeac15", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a7c6cc558f914e288686b7d529eb93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbd1e00-77", "ovs_interfaceid": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=3fbd1e00-7723-461b-ab12-a26d6d5985cb,network=Network(65db01d6-9f50-44a8-a81d-09c4a4eeac15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbd1e00-77') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG os_vif [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=3fbd1e00-7723-461b-ab12-a26d6d5985cb,network=Network(65db01d6-9f50-44a8-a81d-09c4a4eeac15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbd1e00-77') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fbd1e00-77, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fbd1e00-77, col_values=(('external_ids', {'iface-id': '3fbd1e00-7723-461b-ab12-a26d6d5985cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:55:bb', 'vm-uuid': '3793d67f-b6a0-4eba-8f26-8358e30f12d6'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:32 user nova-compute[73627]: INFO os_vif [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=3fbd1e00-7723-461b-ab12-a26d6d5985cb,network=Network(65db01d6-9f50-44a8-a81d-09c4a4eeac15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbd1e00-77')
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] No VIF found with MAC fa:16:3e:43:55:bb, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-a7ef5cbf-9103-4134-9463-6569322e576c req-d821974f-4779-4650-9294-528f98399845 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Updated VIF entry in instance network info cache for port 3fbd1e00-7723-461b-ab12-a26d6d5985cb. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:39:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-a7ef5cbf-9103-4134-9463-6569322e576c req-d821974f-4779-4650-9294-528f98399845 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Updating instance_info_cache with network_info: [{"id": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "address": "fa:16:3e:43:55:bb", "network": {"id": "65db01d6-9f50-44a8-a81d-09c4a4eeac15", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a7c6cc558f914e288686b7d529eb93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbd1e00-77", "ovs_interfaceid": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:39:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7ef5cbf-9103-4134-9463-6569322e576c req-d821974f-4779-4650-9294-528f98399845 service nova] Releasing lock "refresh_cache-3793d67f-b6a0-4eba-8f26-8358e30f12d6" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:39:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-0da19fa3-021c-4acc-a99e-e2a72c37d084 req-074df2c2-7472-441d-8b6f-83ca48c45f0e service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Received event network-vif-plugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0da19fa3-021c-4acc-a99e-e2a72c37d084 req-074df2c2-7472-441d-8b6f-83ca48c45f0e service nova] Acquiring lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0da19fa3-021c-4acc-a99e-e2a72c37d084 req-074df2c2-7472-441d-8b6f-83ca48c45f0e service nova] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0da19fa3-021c-4acc-a99e-e2a72c37d084 req-074df2c2-7472-441d-8b6f-83ca48c45f0e service nova] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-0da19fa3-021c-4acc-a99e-e2a72c37d084 req-074df2c2-7472-441d-8b6f-83ca48c45f0e service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] No waiting events found dispatching network-vif-plugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:39:34 user nova-compute[73627]: WARNING nova.compute.manager [req-0da19fa3-021c-4acc-a99e-e2a72c37d084 req-074df2c2-7472-441d-8b6f-83ca48c45f0e service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Received unexpected event network-vif-plugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb for instance with vm_state building and task_state spawning.
Aug 26 16:39:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-fa6b0ad8-3370-4cb6-b713-8ab530d9f4e7 req-1c9efcf0-104c-4252-bca6-3267538898e4 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Received event network-vif-plugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fa6b0ad8-3370-4cb6-b713-8ab530d9f4e7 req-1c9efcf0-104c-4252-bca6-3267538898e4 service nova] Acquiring lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fa6b0ad8-3370-4cb6-b713-8ab530d9f4e7 req-1c9efcf0-104c-4252-bca6-3267538898e4 service nova] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fa6b0ad8-3370-4cb6-b713-8ab530d9f4e7 req-1c9efcf0-104c-4252-bca6-3267538898e4 service nova] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-fa6b0ad8-3370-4cb6-b713-8ab530d9f4e7 req-1c9efcf0-104c-4252-bca6-3267538898e4 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] No waiting events found dispatching network-vif-plugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:39:36 user nova-compute[73627]: WARNING nova.compute.manager [req-fa6b0ad8-3370-4cb6-b713-8ab530d9f4e7 req-1c9efcf0-104c-4252-bca6-3267538898e4 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Received unexpected event network-vif-plugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb for instance with vm_state building and task_state spawning.
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067976.6392624, 3793d67f-b6a0-4eba-8f26-8358e30f12d6 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:39:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] VM Resumed (Lifecycle Event)
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:39:36 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Instance spawned successfully.
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:39:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693067976.6420393, 3793d67f-b6a0-4eba-8f26-8358e30f12d6 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:39:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] VM Started (Lifecycle Event)
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:39:36 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:39:36 user nova-compute[73627]: INFO nova.compute.manager [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 26 16:39:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:39:36 user nova-compute[73627]: INFO nova.compute.manager [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Took 7.57 seconds to build instance.
Aug 26 16:39:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c7532517-3026-459a-bd2d-0ed7e2874bd5 tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.693s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG nova.objects.instance [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 11b98779-e085-4af6-a5eb-59350f4a4d52 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:40 user nova-compute[73627]: INFO nova.compute.manager [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Attaching volume 179e129e-f669-4736-9142-6b0a8a14e40c to /dev/vdc
Aug 26 16:39:40 user nova-compute[73627]: DEBUG os_brick.utils [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73f647a-9133-42f1-8d8c-715ed5de6b93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc44db0d-f44f-4271-b412-5fb16fcf1ce0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafecb73-8cde-4fa2-b5c9-0987830177e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4cf346-cbdb-4cb6-8c17-999ae15c531e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:39:40 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:39:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a14985-30e5-4bb0-b63a-c03bbc36faa5]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG os_brick.utils [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Updating existing volume attachment record: 0109fb43-2c4b-4d4c-86f8-19dbe38668cf {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:39:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "a6f68ea4-789d-4456-a82d-d067384b566b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:47 user nova-compute[73627]: INFO nova.compute.manager [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Terminating instance
Aug 26 16:39:47 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:39:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-ae72906f-2f88-4dcd-8a5a-56348891e88e req-1b4da378-3508-4494-8dbb-ebc01f42ad6a service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-unplugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ae72906f-2f88-4dcd-8a5a-56348891e88e req-1b4da378-3508-4494-8dbb-ebc01f42ad6a service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ae72906f-2f88-4dcd-8a5a-56348891e88e req-1b4da378-3508-4494-8dbb-ebc01f42ad6a service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ae72906f-2f88-4dcd-8a5a-56348891e88e req-1b4da378-3508-4494-8dbb-ebc01f42ad6a service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-ae72906f-2f88-4dcd-8a5a-56348891e88e req-1b4da378-3508-4494-8dbb-ebc01f42ad6a service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-unplugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-ae72906f-2f88-4dcd-8a5a-56348891e88e req-1b4da378-3508-4494-8dbb-ebc01f42ad6a service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-unplugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:48 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Instance destroyed successfully.
Aug 26 16:39:48 user nova-compute[73627]: DEBUG nova.objects.instance [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'resources' on Instance uuid a6f68ea4-789d-4456-a82d-d067384b566b {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-167969385',display_name='tempest-ServerRescueNegativeTestJSON-server-167969385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-167969385',id=4,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-atgh31tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:25:08Z,user_data=None,user_id='acdf029015a64f89aa51e6559e0f962c',uuid=a6f68ea4-789d-4456-a82d-d067384b566b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "afd1a924-cb15-439a-b687-1dde16f591d5", "address": "fa:16:3e:89:b1:c3", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd1a924-cb", "ovs_interfaceid": "afd1a924-cb15-439a-b687-1dde16f591d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:b1:c3,bridge_name='br-int',has_traffic_filtering=True,id=afd1a924-cb15-439a-b687-1dde16f591d5,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd1a924-cb') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG os_vif [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:b1:c3,bridge_name='br-int',has_traffic_filtering=True,id=afd1a924-cb15-439a-b687-1dde16f591d5,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd1a924-cb') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafd1a924-cb, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:48 user nova-compute[73627]: INFO os_vif [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:b1:c3,bridge_name='br-int',has_traffic_filtering=True,id=afd1a924-cb15-439a-b687-1dde16f591d5,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd1a924-cb')
Aug 26 16:39:48 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Deleting instance files /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b_del
Aug 26 16:39:48 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Deletion of /opt/stack/data/nova/instances/a6f68ea4-789d-4456-a82d-d067384b566b_del complete
Aug 26 16:39:48 user nova-compute[73627]: INFO nova.compute.manager [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 26 16:39:48 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:49 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:39:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-aee159ba-892e-4788-8a4c-e30f1af63cb3 req-a0105773-82da-4968-984d-9b3f7648bfae service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-deleted-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:49 user nova-compute[73627]: INFO nova.compute.manager [req-aee159ba-892e-4788-8a4c-e30f1af63cb3 req-a0105773-82da-4968-984d-9b3f7648bfae service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Neutron deleted interface afd1a924-cb15-439a-b687-1dde16f591d5; detaching it from the instance and deleting it from the info cache
Aug 26 16:39:49 user nova-compute[73627]: DEBUG nova.network.neutron [req-aee159ba-892e-4788-8a4c-e30f1af63cb3 req-a0105773-82da-4968-984d-9b3f7648bfae service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:39:49 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Took 0.77 seconds to deallocate network for instance.
Aug 26 16:39:49 user nova-compute[73627]: DEBUG nova.compute.manager [req-aee159ba-892e-4788-8a4c-e30f1af63cb3 req-a0105773-82da-4968-984d-9b3f7648bfae service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Detach interface failed, port_id=afd1a924-cb15-439a-b687-1dde16f591d5, reason: Instance a6f68ea4-789d-4456-a82d-d067384b566b could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:39:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:49 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:39:49 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:39:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:49 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Deleted allocations for instance a6f68ea4-789d-4456-a82d-d067384b566b
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1920e3ee-3d66-4c98-8014-99f041272d02 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "a6f68ea4-789d-4456-a82d-d067384b566b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.701s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:39:50 user nova-compute[73627]: WARNING nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received unexpected event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with vm_state deleted and task_state None.
Aug 26 16:39:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:39:50 user nova-compute[73627]: WARNING nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received unexpected event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with vm_state deleted and task_state None.
Aug 26 16:39:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:39:50 user nova-compute[73627]: WARNING nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received unexpected event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with vm_state deleted and task_state None.
Aug 26 16:39:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-unplugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-unplugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:39:50 user nova-compute[73627]: WARNING nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received unexpected event network-vif-unplugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with vm_state deleted and task_state None.
Aug 26 16:39:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Acquiring lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] Lock "a6f68ea4-789d-4456-a82d-d067384b566b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] No waiting events found dispatching network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:39:50 user nova-compute[73627]: WARNING nova.compute.manager [req-c9d5eb1d-f9ac-4536-b74d-ea01e7616b56 req-14a8ccd1-a8f1-43af-80eb-fedb28bc78e9 service nova] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Received unexpected event network-vif-plugged-afd1a924-cb15-439a-b687-1dde16f591d5 for instance with vm_state deleted and task_state None.
Aug 26 16:39:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sDxLGmNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:39:53 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:39:53 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:39:53 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc075219-7d76-43aa-9ff2-d91e9d2b813b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:39:53 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a58c1b-0f70-47f3-8c91-e12db879076c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c] added
Aug 26 16:39:53 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[180fd802-1dab-400a-8b19-478f775966a8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca90f497-7742-48e7-9dbe-7066ec824e54]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sDxLGmNS {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sDxLGmNS" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b841675-e8ce-413c-9041-abe9ac22b61d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sDxLGmNS'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f195b5-4c51-4cd0-82d4-387bfb6781dc]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8423797-bde6-4041-b316-422587cfc731]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)
Aug 26 16:39:53 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)
Aug 26 16:39:53 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d314f6-3f0a-44ad-b680-ee44a51ffc68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c, portal: 172.16.0.220,3260]
Aug 26 16:39:53 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c, portal: 172.16.0.220,3260] successful.
Aug 26 16:39:53 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d9edde-522b-45b9-b1e9-65a8d4e956c8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[90db188c-7f32-4b0f-b62d-4e0ae6828571]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)
Aug 26 16:39:54 user nova-compute[73627]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c (non-flash)
Aug 26 16:39:54 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)
Aug 26 16:39:54 user nova-compute[73627]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c (non-flash)
Aug 26 16:39:54 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c45f6db-7d40-4820-a134-c6673360798b]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:39:54 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sDxLGmNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:39:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:39:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26164346564646131', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:39:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164346564646131', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:39:55 user nova-compute[73627]: DEBUG nova.objects.instance [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 11b98779-e085-4af6-a5eb-59350f4a4d52 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:39:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:39:55 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:39:55 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:39:55 user nova-compute[73627]:   <target dev="vdc" bus="virtio"/>
Aug 26 16:39:55 user nova-compute[73627]:   <serial>179e129e-f669-4736-9142-6b0a8a14e40c</serial>
Aug 26 16:39:55 user nova-compute[73627]: </disk>
Aug 26 16:39:55 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:39:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:39:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:39:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:39:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] No VIF found with MAC fa:16:3e:71:b0:94, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:39:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-eaa4bb10-eb45-41b9-b521-18ae5a69ca11 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.256s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:39:57 user nova-compute[73627]: INFO nova.compute.manager [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Detaching volume 2429419e-8a7a-46fc-9423-89a17a79551f
Aug 26 16:39:57 user nova-compute[73627]: INFO nova.virt.block_device [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Attempting to driver detach volume 2429419e-8a7a-46fc-9423-89a17a79551f from mountpoint /dev/vdb
Aug 26 16:39:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Attempting to detach device vdb from instance 11b98779-e085-4af6-a5eb-59350f4a4d52 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:39:57 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:39:57 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:39:57 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:39:57 user nova-compute[73627]:   <serial>2429419e-8a7a-46fc-9423-89a17a79551f</serial>
Aug 26 16:39:57 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:39:57 user nova-compute[73627]: </disk>
Aug 26 16:39:57 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:39:57 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully detached device vdb from instance 11b98779-e085-4af6-a5eb-59350f4a4d52 from the persistent domain config.
Aug 26 16:39:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11b98779-e085-4af6-a5eb-59350f4a4d52 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:39:57 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:39:57 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:39:57 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:39:57 user nova-compute[73627]:   <serial>2429419e-8a7a-46fc-9423-89a17a79551f</serial>
Aug 26 16:39:57 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:39:57 user nova-compute[73627]: </disk>
Aug 26 16:39:57 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693067997.7614474, 11b98779-e085-4af6-a5eb-59350f4a4d52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11b98779-e085-4af6-a5eb-59350f4a4d52 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:39:57 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully detached device vdb from instance 11b98779-e085-4af6-a5eb-59350f4a4d52 from the live domain config.
Aug 26 16:39:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELnJxeub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:39:57 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:39:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.057s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1769d6e5-c81c-4114-97f1-8c33fd88697b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b6d4ee-4bdc-4de7-a733-47f43fc97624]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)
Aug 26 16:39:57 user nova-compute[73627]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c (non-flash)
Aug 26 16:39:57 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f (non-flash)
Aug 26 16:39:57 user nova-compute[73627]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c (non-flash)
Aug 26 16:39:57 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d0241510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:39:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.142s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccf0303-06e4-4e6e-b12e-e90ed5b2730d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.183s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba65cd3-f6e0-49f9-9cd2-f57b3fa3ae40]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[290e9f43-594c-4153-a14b-565f7a4a877f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[41598a78-3bc8-4866-938a-3e000ffb43f4]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3ced02-6cca-494e-a2b1-f33141ab381b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7a3c84-f608-402b-accf-cd9734fd08ce]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f, portal: 172.16.0.220,3260]
Aug 26 16:39:58 user nova-compute[73627]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f, portal: 172.16.0.220,3260] successful.
Aug 26 16:39:58 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2429419e-8a7a-46fc-9423-89a17a79551f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c0d9ec-73cf-441f-a0c8-b911c95751f9]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.631s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] <== disconnect_volume: return (633ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:39:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:39:59 user nova-compute[73627]: DEBUG nova.objects.instance [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 11b98779-e085-4af6-a5eb-59350f4a4d52 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:39:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-caa851aa-11a9-4200-8f6e-8ea99c191161 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.317s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:39:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:00 user nova-compute[73627]: INFO nova.compute.manager [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Detaching volume 179e129e-f669-4736-9142-6b0a8a14e40c
Aug 26 16:40:00 user nova-compute[73627]: INFO nova.virt.block_device [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Attempting to driver detach volume 179e129e-f669-4736-9142-6b0a8a14e40c from mountpoint /dev/vdc
Aug 26 16:40:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Attempting to detach device vdc from instance 11b98779-e085-4af6-a5eb-59350f4a4d52 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:40:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:40:00 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:40:00 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:40:00 user nova-compute[73627]:   <target dev="vdc" bus="virtio"/>
Aug 26 16:40:00 user nova-compute[73627]:   <serial>179e129e-f669-4736-9142-6b0a8a14e40c</serial>
Aug 26 16:40:00 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 16:40:00 user nova-compute[73627]: </disk>
Aug 26 16:40:00 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:40:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:00 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully detached device vdc from instance 11b98779-e085-4af6-a5eb-59350f4a4d52 from the persistent domain config.
Aug 26 16:40:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 11b98779-e085-4af6-a5eb-59350f4a4d52 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:40:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:40:00 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:40:00 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:40:00 user nova-compute[73627]:   <target dev="vdc" bus="virtio"/>
Aug 26 16:40:00 user nova-compute[73627]:   <serial>179e129e-f669-4736-9142-6b0a8a14e40c</serial>
Aug 26 16:40:00 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 16:40:00 user nova-compute[73627]: </disk>
Aug 26 16:40:00 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693068001.290477, 11b98779-e085-4af6-a5eb-59350f4a4d52 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 11b98779-e085-4af6-a5eb-59350f4a4d52 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:40:01 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully detached device vdc from instance 11b98779-e085-4af6-a5eb-59350f4a4d52 from the live domain config.
Aug 26 16:40:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sDxLGmNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:40:01 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[46335692-3bee-462d-b031-60555e395dbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7025590e-21dc-42f5-9dad-3bced43e0851]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c (non-flash)
Aug 26 16:40:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c (non-flash)
Aug 26 16:40:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e82c6ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c978c707-03fb-4a78-b2c2-cdff4c02f8e2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.037s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce638387-59f8-4d28-b314-3dbc8d9daa68]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b554a4-2be6-490a-aac5-fcbc8cf578b8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f69a2e-1a43-4d6c-b4b2-25df7ebba249]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[945d1704-45ad-4644-a76c-1d22adb56b47]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d5d298-073a-4b68-a4f7-9b96e0057ce0]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c, portal: 172.16.0.220,3260]
Aug 26 16:40:01 user nova-compute[73627]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c, portal: 172.16.0.220,3260] successful.
Aug 26 16:40:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:179e129e-f669-4736-9142-6b0a8a14e40c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a0e551-0afb-4888-8e9a-b3988d3fe5f7]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] <== disconnect_volume: return (328ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:40:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:40:02 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'flavor' on Instance uuid 11b98779-e085-4af6-a5eb-59350f4a4d52 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:40:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6880812e-5144-4d36-aaca-e7ea99d0a569 tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.845s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:03 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693067988.536933, a6f68ea4-789d-4456-a82d-d067384b566b => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:40:03 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] VM Stopped (Lifecycle Event)
Aug 26 16:40:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-481596e7-7b97-49af-bada-db3c9ea97e66 None None] [instance: a6f68ea4-789d-4456-a82d-d067384b566b] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:40:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:03 user nova-compute[73627]: INFO nova.compute.manager [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Terminating instance
Aug 26 16:40:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:40:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-9c7902d7-f4df-4378-ade0-4b99a0f8f6ff req-f82cac07-a822-4954-93dc-e9531ec8557b service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Received event network-vif-unplugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9c7902d7-f4df-4378-ade0-4b99a0f8f6ff req-f82cac07-a822-4954-93dc-e9531ec8557b service nova] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9c7902d7-f4df-4378-ade0-4b99a0f8f6ff req-f82cac07-a822-4954-93dc-e9531ec8557b service nova] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9c7902d7-f4df-4378-ade0-4b99a0f8f6ff req-f82cac07-a822-4954-93dc-e9531ec8557b service nova] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-9c7902d7-f4df-4378-ade0-4b99a0f8f6ff req-f82cac07-a822-4954-93dc-e9531ec8557b service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] No waiting events found dispatching network-vif-unplugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-9c7902d7-f4df-4378-ade0-4b99a0f8f6ff req-f82cac07-a822-4954-93dc-e9531ec8557b service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Received event network-vif-unplugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:40:04 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Instance destroyed successfully.
Aug 26 16:40:04 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lazy-loading 'resources' on Instance uuid 11b98779-e085-4af6-a5eb-59350f4a4d52 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800808689',display_name='tempest-AttachVolumeTestJSON-server-800808689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-800808689',id=33,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUUWKK7k1zxFZzwYG/3BOHWTPUpogxztBGVECSrZrhWTrVA1un2Okr2Ve2OTeczPBjzvoz6PqQFY8mw1ORdnB37VCWO45tIHZ7IZvU3RoW5EioUHXfOn8m14Tddxjo35Q==',key_name='tempest-keypair-1090823722',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:37:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='875ad08232174cb391be66a7d5605d8d',ramdisk_id='',reservation_id='r-0wvdm2zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1152498749',owner_user_name='tempest-AttachVolumeTestJSON-1152498749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:37:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5067f58846cf44fc9799db04de44d116',uuid=11b98779-e085-4af6-a5eb-59350f4a4d52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "address": "fa:16:3e:71:b0:94", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c5422-05", "ovs_interfaceid": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converting VIF {"id": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "address": "fa:16:3e:71:b0:94", "network": {"id": "7c9571a9-fcc8-412f-ab37-c14b5cfa6e73", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1223559579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "875ad08232174cb391be66a7d5605d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap766c5422-05", "ovs_interfaceid": "766c5422-05f4-4eca-96c7-c646c45a5fd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=766c5422-05f4-4eca-96c7-c646c45a5fd1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c5422-05') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG os_vif [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=766c5422-05f4-4eca-96c7-c646c45a5fd1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c5422-05') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap766c5422-05, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:40:04 user nova-compute[73627]: INFO os_vif [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=766c5422-05f4-4eca-96c7-c646c45a5fd1,network=Network(7c9571a9-fcc8-412f-ab37-c14b5cfa6e73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap766c5422-05')
Aug 26 16:40:04 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Deleting instance files /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52_del
Aug 26 16:40:04 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Deletion of /opt/stack/data/nova/instances/11b98779-e085-4af6-a5eb-59350f4a4d52_del complete
Aug 26 16:40:04 user nova-compute[73627]: INFO nova.compute.manager [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 26 16:40:04 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:04 user nova-compute[73627]: INFO nova.compute.manager [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Terminating instance
Aug 26 16:40:04 user nova-compute[73627]: DEBUG nova.compute.manager [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-2416c58d-7f54-4994-99c9-368f386aac4c req-d6734c2e-7798-47f9-9bb1-d89fbd8e728d service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-unplugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2416c58d-7f54-4994-99c9-368f386aac4c req-d6734c2e-7798-47f9-9bb1-d89fbd8e728d service nova] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2416c58d-7f54-4994-99c9-368f386aac4c req-d6734c2e-7798-47f9-9bb1-d89fbd8e728d service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2416c58d-7f54-4994-99c9-368f386aac4c req-d6734c2e-7798-47f9-9bb1-d89fbd8e728d service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-2416c58d-7f54-4994-99c9-368f386aac4c req-d6734c2e-7798-47f9-9bb1-d89fbd8e728d service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] No waiting events found dispatching network-vif-unplugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-2416c58d-7f54-4994-99c9-368f386aac4c req-d6734c2e-7798-47f9-9bb1-d89fbd8e728d service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-unplugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "98114285-9c1d-4ff4-9121-77bd1a798200" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:05 user nova-compute[73627]: INFO nova.compute.manager [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Unshelving
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Instance destroyed successfully.
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.objects.instance [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'resources' on Instance uuid 8e049438-4a89-4bc9-bd98-397c8c699fc9 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401986763',display_name='tempest-TestMinimumBasicScenario-server-1401986763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401986763',id=31,image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvGb6OgS4/exGLauNisDrmDk77vIvVYHyzKMvy12SdxmWjlFxuHxBz+ABfkBoNAITGCTjFnOALKtOiV1awPZM4LY5xuhILyJgwDK9Pu86m2c2Mbjfxy5ew/i3hBTH56bA==',key_name='tempest-TestMinimumBasicScenario-1334019721',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c5a07134941420ba915917e23449851',ramdisk_id='',reservation_id='r-ym847cwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53282c5c-8791-40e6-b0f8-6ba17d690089',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-808712581',owner_user_name='tempest-TestMinimumBasicScenario-808712581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:37:16Z,user_data=None,user_id='a676ca6fc331417d8f835ebcf8181cfb',uuid=8e049438-4a89-4bc9-bd98-397c8c699fc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converting VIF {"id": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "address": "fa:16:3e:6e:27:2c", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a452b-b4", "ovs_interfaceid": "9f3a452b-b466-40bd-809e-38d61cd3ba5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG os_vif [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f3a452b-b4, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:40:05 user nova-compute[73627]: INFO os_vif [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:27:2c,bridge_name='br-int',has_traffic_filtering=True,id=9f3a452b-b466-40bd-809e-38d61cd3ba5e,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a452b-b4')
Aug 26 16:40:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Deleting instance files /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9_del
Aug 26 16:40:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Deletion of /opt/stack/data/nova/instances/8e049438-4a89-4bc9-bd98-397c8c699fc9_del complete
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.objects.instance [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'pci_requests' on Instance uuid 98114285-9c1d-4ff4-9121-77bd1a798200 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:40:05 user nova-compute[73627]: INFO nova.compute.manager [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 26 16:40:05 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.objects.instance [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'numa_topology' on Instance uuid 98114285-9c1d-4ff4-9121-77bd1a798200 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:40:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:40:05 user nova-compute[73627]: INFO nova.compute.claims [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Claim successful on node user
Aug 26 16:40:06 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-805e3948-b46d-4950-a36a-eee5d1cf7a1d req-6372d7b9-81c5-4aeb-b310-18754bd4f477 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Received event network-vif-deleted-766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:06 user nova-compute[73627]: INFO nova.compute.manager [req-805e3948-b46d-4950-a36a-eee5d1cf7a1d req-6372d7b9-81c5-4aeb-b310-18754bd4f477 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Neutron deleted interface 766c5422-05f4-4eca-96c7-c646c45a5fd1; detaching it from the instance and deleting it from the info cache
Aug 26 16:40:06 user nova-compute[73627]: DEBUG nova.network.neutron [req-805e3948-b46d-4950-a36a-eee5d1cf7a1d req-6372d7b9-81c5-4aeb-b310-18754bd4f477 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:40:06 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Took 1.62 seconds to deallocate network for instance.
Aug 26 16:40:06 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-805e3948-b46d-4950-a36a-eee5d1cf7a1d req-6372d7b9-81c5-4aeb-b310-18754bd4f477 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Detach interface failed, port_id=766c5422-05f4-4eca-96c7-c646c45a5fd1, reason: Instance 11b98779-e085-4af6-a5eb-59350f4a4d52 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-03362178-c2df-4cf5-b22d-326dbd99b8e4 req-980b3d84-a440-4227-aafe-63716ae02ad3 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Received event network-vif-plugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-03362178-c2df-4cf5-b22d-326dbd99b8e4 req-980b3d84-a440-4227-aafe-63716ae02ad3 service nova] Acquiring lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-03362178-c2df-4cf5-b22d-326dbd99b8e4 req-980b3d84-a440-4227-aafe-63716ae02ad3 service nova] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-03362178-c2df-4cf5-b22d-326dbd99b8e4 req-980b3d84-a440-4227-aafe-63716ae02ad3 service nova] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-03362178-c2df-4cf5-b22d-326dbd99b8e4 req-980b3d84-a440-4227-aafe-63716ae02ad3 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] No waiting events found dispatching network-vif-plugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:06 user nova-compute[73627]: WARNING nova.compute.manager [req-03362178-c2df-4cf5-b22d-326dbd99b8e4 req-980b3d84-a440-4227-aafe-63716ae02ad3 service nova] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Received unexpected event network-vif-plugged-766c5422-05f4-4eca-96c7-c646c45a5fd1 for instance with vm_state deleted and task_state None.
Aug 26 16:40:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:06 user nova-compute[73627]: INFO nova.network.neutron [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updating port 8437f747-1797-4480-9ad4-52e88581f6c1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:40:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:06 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Deleted allocations for instance 11b98779-e085-4af6-a5eb-59350f4a4d52
Aug 26 16:40:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8e65cbdb-0b83-4243-a9d1-cce28b5608dd tempest-AttachVolumeTestJSON-1152498749 tempest-AttachVolumeTestJSON-1152498749-project-member] Lock "11b98779-e085-4af6-a5eb-59350f4a4d52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.214s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:40:07 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Took 1.40 seconds to deallocate network for instance.
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] No waiting events found dispatching network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:07 user nova-compute[73627]: WARNING nova.compute.manager [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received unexpected event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e for instance with vm_state deleted and task_state None.
Aug 26 16:40:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] No waiting events found dispatching network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:07 user nova-compute[73627]: WARNING nova.compute.manager [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received unexpected event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e for instance with vm_state deleted and task_state None.
Aug 26 16:40:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] No waiting events found dispatching network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:07 user nova-compute[73627]: WARNING nova.compute.manager [req-e607b8ec-6dc3-4d01-848b-2ce096415c65 req-4f861cc3-73cf-4793-b900-a789576dbcea service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received unexpected event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e for instance with vm_state deleted and task_state None.
Aug 26 16:40:07 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquired lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:07 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Deleted allocations for instance 8e049438-4a89-4bc9-bd98-397c8c699fc9
Aug 26 16:40:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-50c6676d-7432-4217-a92c-078aa7a2079f tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.967s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updating instance_info_cache with network_info: [{"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Releasing lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:40:08 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Creating image(s)
Aug 26 16:40:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "/opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "/opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "/opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG nova.objects.instance [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'trusted_certs' on Instance uuid 98114285-9c1d-4ff4-9121-77bd1a798200 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-2bfd1858-bfdc-44f0-b44f-93351e309ae7 req-82c271ea-04b9-4b75-87b1-60967083c1a8 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-changed-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-2bfd1858-bfdc-44f0-b44f-93351e309ae7 req-82c271ea-04b9-4b75-87b1-60967083c1a8 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Refreshing instance network info cache due to event network-changed-8437f747-1797-4480-9ad4-52e88581f6c1. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2bfd1858-bfdc-44f0-b44f-93351e309ae7 req-82c271ea-04b9-4b75-87b1-60967083c1a8 service nova] Acquiring lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2bfd1858-bfdc-44f0-b44f-93351e309ae7 req-82c271ea-04b9-4b75-87b1-60967083c1a8 service nova] Acquired lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG nova.network.neutron [req-2bfd1858-bfdc-44f0-b44f-93351e309ae7 req-82c271ea-04b9-4b75-87b1-60967083c1a8 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Refreshing network info cache for port 8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG nova.objects.base [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Object Instance<98114285-9c1d-4ff4-9121-77bd1a798200> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a.part --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-c073cb41-74b8-4a85-8a11-7fb7b7f7a54c req-809a3081-90c6-4dda-a9f7-09ac40793b38 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-deleted-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-da3e7ead-677e-41d0-be6c-9c5263b34dff req-5492cbba-4af4-4d19-99ca-5be42c13c319 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-da3e7ead-677e-41d0-be6c-9c5263b34dff req-5492cbba-4af4-4d19-99ca-5be42c13c319 service nova] Acquiring lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-da3e7ead-677e-41d0-be6c-9c5263b34dff req-5492cbba-4af4-4d19-99ca-5be42c13c319 service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-da3e7ead-677e-41d0-be6c-9c5263b34dff req-5492cbba-4af4-4d19-99ca-5be42c13c319 service nova] Lock "8e049438-4a89-4bc9-bd98-397c8c699fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-da3e7ead-677e-41d0-be6c-9c5263b34dff req-5492cbba-4af4-4d19-99ca-5be42c13c319 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] No waiting events found dispatching network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:09 user nova-compute[73627]: WARNING nova.compute.manager [req-da3e7ead-677e-41d0-be6c-9c5263b34dff req-5492cbba-4af4-4d19-99ca-5be42c13c319 service nova] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Received unexpected event network-vif-plugged-9f3a452b-b466-40bd-809e-38d61cd3ba5e for instance with vm_state deleted and task_state None.
Aug 26 16:40:09 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:40:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a.part --force-share --output=json" returned: 0 in 0.197s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:09 user nova-compute[73627]: DEBUG nova.virt.images [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] d47ace34-7793-4ee7-96f5-0fcb655d18b1 was qcow2, converting to raw {{(pid=73627) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 16:40:09 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:40:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a.part /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a.converted {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG nova.network.neutron [req-2bfd1858-bfdc-44f0-b44f-93351e309ae7 req-82c271ea-04b9-4b75-87b1-60967083c1a8 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updated VIF entry in instance network info cache for port 8437f747-1797-4480-9ad4-52e88581f6c1. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG nova.network.neutron [req-2bfd1858-bfdc-44f0-b44f-93351e309ae7 req-82c271ea-04b9-4b75-87b1-60967083c1a8 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updating instance_info_cache with network_info: [{"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-2bfd1858-bfdc-44f0-b44f-93351e309ae7 req-82c271ea-04b9-4b75-87b1-60967083c1a8 service nova] Releasing lock "refresh_cache-98114285-9c1d-4ff4-9121-77bd1a798200" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a.part /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a.converted" returned: 0 in 0.596s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a.converted --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.160s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a --force-share --output=json" returned: 0 in 0.174s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a,backing_fmt=raw /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a,backing_fmt=raw /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk 1073741824" returned: 0 in 0.049s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:11 user nova-compute[73627]: DEBUG nova.objects.instance [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'migration_context' on Instance uuid 98114285-9c1d-4ff4-9121-77bd1a798200 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:40:11 user nova-compute[73627]: DEBUG nova.objects.base [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Object Instance<98114285-9c1d-4ff4-9121-77bd1a798200> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:40:11 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Rebasing disk image.
Aug 26 16:40:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 -F raw /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:40:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:40:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:40:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:12 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:40:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 -F raw /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk" returned: 0 in 2.200s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Ensure instance console log exists: /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Start _get_guest_xml network_info=[{"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5f0e958f85426f1de153949234e18978',container_format='bare',created_at=2023-08-26T16:38:11Z,direct_url=<?>,disk_format='qcow2',id=d47ace34-7793-4ee7-96f5-0fcb655d18b1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-233452645-shelved',owner='93acb667ea194ce4b6f55e4e86fe9f5c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T16:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:40:13 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:40:13 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5f0e958f85426f1de153949234e18978',container_format='bare',created_at=2023-08-26T16:38:11Z,direct_url=<?>,disk_format='qcow2',id=d47ace34-7793-4ee7-96f5-0fcb655d18b1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-233452645-shelved',owner='93acb667ea194ce4b6f55e4e86fe9f5c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T16:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.objects.instance [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'vcpu_model' on Instance uuid 98114285-9c1d-4ff4-9121-77bd1a798200 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.objects.base [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Object Instance<98114285-9c1d-4ff4-9121-77bd1a798200> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-233452645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-233452645',id=32,image_ref='d47ace34-7793-4ee7-96f5-0fcb655d18b1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-9464290',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-ln08v5k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member',shelved_at='2023-08-26T16:38:16.311255',shelved_host='user',shelved_image_id='d47ace34-7793-4ee7-96f5-0fcb655d18b1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:40:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=98114285-9c1d-4ff4-9121-77bd1a798200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.objects.instance [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'pci_devices' on Instance uuid 98114285-9c1d-4ff4-9121-77bd1a798200 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.objects.base [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Object Instance<98114285-9c1d-4ff4-9121-77bd1a798200> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:40:13 user nova-compute[73627]:   <uuid>98114285-9c1d-4ff4-9121-77bd1a798200</uuid>
Aug 26 16:40:13 user nova-compute[73627]:   <name>instance-00000020</name>
Aug 26 16:40:13 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:40:13 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:40:13 user nova-compute[73627]:   <metadata>
Aug 26 16:40:13 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:40:13 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:40:13 user nova-compute[73627]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-233452645</nova:name>
Aug 26 16:40:13 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:40:13</nova:creationTime>
Aug 26 16:40:13 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:40:13 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:40:13 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:40:13 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:40:13 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:40:13 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:40:13 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:40:13 user nova-compute[73627]:       <nova:owner>
Aug 26 16:40:13 user nova-compute[73627]:         <nova:user uuid="c01a881f130f4cbe9c70e2acd4842b8d">tempest-AttachVolumeShelveTestJSON-2118968964-project-member</nova:user>
Aug 26 16:40:13 user nova-compute[73627]:         <nova:project uuid="93acb667ea194ce4b6f55e4e86fe9f5c">tempest-AttachVolumeShelveTestJSON-2118968964</nova:project>
Aug 26 16:40:13 user nova-compute[73627]:       </nova:owner>
Aug 26 16:40:13 user nova-compute[73627]:       <nova:root type="image" uuid="d47ace34-7793-4ee7-96f5-0fcb655d18b1"/>
Aug 26 16:40:13 user nova-compute[73627]:       <nova:ports>
Aug 26 16:40:13 user nova-compute[73627]:         <nova:port uuid="8437f747-1797-4480-9ad4-52e88581f6c1">
Aug 26 16:40:13 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 16:40:13 user nova-compute[73627]:         </nova:port>
Aug 26 16:40:13 user nova-compute[73627]:       </nova:ports>
Aug 26 16:40:13 user nova-compute[73627]:     </nova:instance>
Aug 26 16:40:13 user nova-compute[73627]:   </metadata>
Aug 26 16:40:13 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:40:13 user nova-compute[73627]:     <system>
Aug 26 16:40:13 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:40:13 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:40:13 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:40:13 user nova-compute[73627]:       <entry name="serial">98114285-9c1d-4ff4-9121-77bd1a798200</entry>
Aug 26 16:40:13 user nova-compute[73627]:       <entry name="uuid">98114285-9c1d-4ff4-9121-77bd1a798200</entry>
Aug 26 16:40:13 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:40:13 user nova-compute[73627]:     </system>
Aug 26 16:40:13 user nova-compute[73627]:   </sysinfo>
Aug 26 16:40:13 user nova-compute[73627]:   <os>
Aug 26 16:40:13 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:40:13 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:40:13 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:40:13 user nova-compute[73627]:   </os>
Aug 26 16:40:13 user nova-compute[73627]:   <features>
Aug 26 16:40:13 user nova-compute[73627]:     <acpi/>
Aug 26 16:40:13 user nova-compute[73627]:     <apic/>
Aug 26 16:40:13 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:40:13 user nova-compute[73627]:   </features>
Aug 26 16:40:13 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:40:13 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:40:13 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:40:13 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:40:13 user nova-compute[73627]:   </clock>
Aug 26 16:40:13 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:40:13 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:40:13 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:40:13 user nova-compute[73627]:   </cpu>
Aug 26 16:40:13 user nova-compute[73627]:   <devices>
Aug 26 16:40:13 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:40:13 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:40:13 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk"/>
Aug 26 16:40:13 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:40:13 user nova-compute[73627]:     </disk>
Aug 26 16:40:13 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:40:13 user nova-compute[73627]:       <mac address="fa:16:3e:a0:1d:97"/>
Aug 26 16:40:13 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:40:13 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:40:13 user nova-compute[73627]:       <target dev="tap8437f747-17"/>
Aug 26 16:40:13 user nova-compute[73627]:     </interface>
Aug 26 16:40:13 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:40:13 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/console.log" append="off"/>
Aug 26 16:40:13 user nova-compute[73627]:     </serial>
Aug 26 16:40:13 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:40:13 user nova-compute[73627]:     <video>
Aug 26 16:40:13 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:40:13 user nova-compute[73627]:     </video>
Aug 26 16:40:13 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:40:13 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:40:13 user nova-compute[73627]:     </rng>
Aug 26 16:40:13 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:40:13 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:40:13 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:40:13 user nova-compute[73627]:     </memballoon>
Aug 26 16:40:13 user nova-compute[73627]:   </devices>
Aug 26 16:40:13 user nova-compute[73627]: </domain>
Aug 26 16:40:13 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-233452645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-233452645',id=32,image_ref='d47ace34-7793-4ee7-96f5-0fcb655d18b1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-9464290',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-ln08v5k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member',shelved_at='2023-08-26T16:38:16.311255',shelved_host='user',shelved_image_id='d47ace34-7793-4ee7-96f5-0fcb655d18b1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:40:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=98114285-9c1d-4ff4-9121-77bd1a798200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG os_vif [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8437f747-17, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8437f747-17, col_values=(('external_ids', {'iface-id': '8437f747-1797-4480-9ad4-52e88581f6c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:1d:97', 'vm-uuid': '98114285-9c1d-4ff4-9121-77bd1a798200'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:13 user nova-compute[73627]: INFO os_vif [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17')
Aug 26 16:40:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:40:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] No VIF found with MAC fa:16:3e:a0:1d:97, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068017.3544598, 98114285-9c1d-4ff4-9121-77bd1a798200 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:40:17 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] VM Resumed (Lifecycle Event)
Aug 26 16:40:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-4803c43f-bc74-459e-a046-340d738a7ee2 req-71905628-6436-4299-87b9-e817c28a81da service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4803c43f-bc74-459e-a046-340d738a7ee2 req-71905628-6436-4299-87b9-e817c28a81da service nova] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4803c43f-bc74-459e-a046-340d738a7ee2 req-71905628-6436-4299-87b9-e817c28a81da service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4803c43f-bc74-459e-a046-340d738a7ee2 req-71905628-6436-4299-87b9-e817c28a81da service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-4803c43f-bc74-459e-a046-340d738a7ee2 req-71905628-6436-4299-87b9-e817c28a81da service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] No waiting events found dispatching network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:17 user nova-compute[73627]: WARNING nova.compute.manager [req-4803c43f-bc74-459e-a046-340d738a7ee2 req-71905628-6436-4299-87b9-e817c28a81da service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received unexpected event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-a82185ec-ad77-47b8-be52-0719e0ddda05 req-27c4588c-db34-427e-9836-65d19ff24e51 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a82185ec-ad77-47b8-be52-0719e0ddda05 req-27c4588c-db34-427e-9836-65d19ff24e51 service nova] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a82185ec-ad77-47b8-be52-0719e0ddda05 req-27c4588c-db34-427e-9836-65d19ff24e51 service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a82185ec-ad77-47b8-be52-0719e0ddda05 req-27c4588c-db34-427e-9836-65d19ff24e51 service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-a82185ec-ad77-47b8-be52-0719e0ddda05 req-27c4588c-db34-427e-9836-65d19ff24e51 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] No waiting events found dispatching network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:17 user nova-compute[73627]: WARNING nova.compute.manager [req-a82185ec-ad77-47b8-be52-0719e0ddda05 req-27c4588c-db34-427e-9836-65d19ff24e51 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received unexpected event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:40:17 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:40:17 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8186MB free_disk=25.240970611572266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Instance spawned successfully.
Aug 26 16:40:17 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068017.3581758, 98114285-9c1d-4ff4-9121-77bd1a798200 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:40:17 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] VM Started (Lifecycle Event)
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:40:17 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 3793d67f-b6a0-4eba-8f26-8358e30f12d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (8659cd71-d22c-49d8-a078-e0d0f2c22090): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:40:17 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:40:18 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:40:18 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:40:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:40:18 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:40:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bd7c1678-baf6-4e08-be69-4dc76b8a03b5 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "98114285-9c1d-4ff4-9121-77bd1a798200" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.499s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:19 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068004.6177127, 11b98779-e085-4af6-a5eb-59350f4a4d52 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:40:19 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] VM Stopped (Lifecycle Event)
Aug 26 16:40:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-819938b4-2819-4c0b-bc3d-1fd0d08002be None None] [instance: 11b98779-e085-4af6-a5eb-59350f4a4d52] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updating instance_info_cache with network_info: [{"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068005.7470927, 8e049438-4a89-4bc9-bd98-397c8c699fc9 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:40:20 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] VM Stopped (Lifecycle Event)
Aug 26 16:40:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cf6e4d31-d197-4cf9-a3b3-ff8e3410f47e None None] [instance: 8e049438-4a89-4bc9-bd98-397c8c699fc9] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:40:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:40:28 user nova-compute[73627]: INFO nova.compute.claims [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Claim successful on node user
Aug 26 16:40:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:40:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:40:28 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:40:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG nova.policy [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8945b1b1110e44568e0de86204d65e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8aed25a3184cf884a5774515d6d202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:40:29 user nova-compute[73627]: INFO nova.virt.block_device [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Booting with volume 54596b99-bdc8-424b-b5bf-55b05a660508 at /dev/vda
Aug 26 16:40:29 user nova-compute[73627]: DEBUG os_brick.utils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a5adc2-534d-4215-a633-43c43a985c4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[845c9307-6e33-498d-909b-53ce17807a2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a34b2db-d663-430f-b40a-e2333fc34374]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[006bf8e3-982d-413f-ae25-298ae737a0bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:40:29 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:40:29 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16e1cf0-6836-4c48-878a-379c3f971af9]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG os_brick.utils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updating existing volume attachment record: c7896e2c-4e83-4252-9eb9-b1fbe278b9fb {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:29 user nova-compute[73627]: DEBUG nova.network.neutron [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Successfully created port: 67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG nova.network.neutron [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Successfully updated port: 67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquired lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG nova.network.neutron [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-e44656c5-5f5d-47ed-956b-165ba9dfda3d req-fad30225-8a51-4a1d-9883-b74657cc62d1 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-changed-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-e44656c5-5f5d-47ed-956b-165ba9dfda3d req-fad30225-8a51-4a1d-9883-b74657cc62d1 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Refreshing instance network info cache due to event network-changed-67554b09-a82b-4a0b-8ff7-fb5e47c7031a. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e44656c5-5f5d-47ed-956b-165ba9dfda3d req-fad30225-8a51-4a1d-9883-b74657cc62d1 service nova] Acquiring lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG nova.network.neutron [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG nova.network.neutron [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updating instance_info_cache with network_info: [{"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Releasing lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG nova.compute.manager [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Instance network_info: |[{"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e44656c5-5f5d-47ed-956b-165ba9dfda3d req-fad30225-8a51-4a1d-9883-b74657cc62d1 service nova] Acquired lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:40:31 user nova-compute[73627]: DEBUG nova.network.neutron [req-e44656c5-5f5d-47ed-956b-165ba9dfda3d req-fad30225-8a51-4a1d-9883-b74657cc62d1 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Refreshing network info cache for port 67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:40:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-e44656c5-5f5d-47ed-956b-165ba9dfda3d req-fad30225-8a51-4a1d-9883-b74657cc62d1 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updated VIF entry in instance network info cache for port 67554b09-a82b-4a0b-8ff7-fb5e47c7031a. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:40:32 user nova-compute[73627]: DEBUG nova.network.neutron [req-e44656c5-5f5d-47ed-956b-165ba9dfda3d req-fad30225-8a51-4a1d-9883-b74657cc62d1 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updating instance_info_cache with network_info: [{"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:40:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e44656c5-5f5d-47ed-956b-165ba9dfda3d req-fad30225-8a51-4a1d-9883-b74657cc62d1 service nova] Releasing lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:40:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:37 user nova-compute[73627]: INFO nova.compute.manager [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Terminating instance
Aug 26 16:40:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-e86f3dae-9852-4713-991f-365be161c984 req-7d3196ee-721c-425a-bcd9-f65bc764a807 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-unplugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e86f3dae-9852-4713-991f-365be161c984 req-7d3196ee-721c-425a-bcd9-f65bc764a807 service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e86f3dae-9852-4713-991f-365be161c984 req-7d3196ee-721c-425a-bcd9-f65bc764a807 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e86f3dae-9852-4713-991f-365be161c984 req-7d3196ee-721c-425a-bcd9-f65bc764a807 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-e86f3dae-9852-4713-991f-365be161c984 req-7d3196ee-721c-425a-bcd9-f65bc764a807 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-unplugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-e86f3dae-9852-4713-991f-365be161c984 req-7d3196ee-721c-425a-bcd9-f65bc764a807 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-unplugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:40:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Instance destroyed successfully.
Aug 26 16:40:38 user nova-compute[73627]: DEBUG nova.objects.instance [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lazy-loading 'resources' on Instance uuid 6907d670-3efe-473c-b03c-eb26c4b7ef4e {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1444531241',display_name='tempest-ServerRescueNegativeTestJSON-server-1444531241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1444531241',id=3,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:28:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f6269e1e9de40b5a5b295651a6fd9b3',ramdisk_id='',reservation_id='r-ec4k8e0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1187038007',owner_user_name='tempest-ServerRescueNegativeTestJSON-1187038007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:29:54Z,user_data=None,user_id='acdf029015a64f89aa51e6559e0f962c',uuid=6907d670-3efe-473c-b03c-eb26c4b7ef4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converting VIF {"id": "7b801568-1011-4cc6-8a1b-b15d44abf741", "address": "fa:16:3e:92:0b:2d", "network": {"id": "12f98e69-2c05-4198-b7af-7735b8ca8a42", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-27896452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f6269e1e9de40b5a5b295651a6fd9b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b801568-10", "ovs_interfaceid": "7b801568-1011-4cc6-8a1b-b15d44abf741", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:0b:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b801568-1011-4cc6-8a1b-b15d44abf741,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b801568-10') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG os_vif [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:0b:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b801568-1011-4cc6-8a1b-b15d44abf741,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b801568-10') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b801568-10, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:40:38 user nova-compute[73627]: INFO os_vif [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:0b:2d,bridge_name='br-int',has_traffic_filtering=True,id=7b801568-1011-4cc6-8a1b-b15d44abf741,network=Network(12f98e69-2c05-4198-b7af-7735b8ca8a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b801568-10')
Aug 26 16:40:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Deleting instance files /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e_del
Aug 26 16:40:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Deletion of /opt/stack/data/nova/instances/6907d670-3efe-473c-b03c-eb26c4b7ef4e_del complete
Aug 26 16:40:38 user nova-compute[73627]: INFO nova.compute.manager [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 16:40:38 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:40:38 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:40:39 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:40:39 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Took 0.55 seconds to deallocate network for instance.
Aug 26 16:40:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:39 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:40:39 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:40:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:39 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Deleted allocations for instance 6907d670-3efe-473c-b03c-eb26c4b7ef4e
Aug 26 16:40:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-49d416b2-aa9a-41a7-b8a1-85dbbb9ea8a0 tempest-ServerRescueNegativeTestJSON-1187038007 tempest-ServerRescueNegativeTestJSON-1187038007-project-member] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.840s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-5861cb08-0008-4b5f-8e1a-da118c1138f3 req-45a3015a-fc29-49b6-8ff2-2c8350e3a8d9 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5861cb08-0008-4b5f-8e1a-da118c1138f3 req-45a3015a-fc29-49b6-8ff2-2c8350e3a8d9 service nova] Acquiring lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5861cb08-0008-4b5f-8e1a-da118c1138f3 req-45a3015a-fc29-49b6-8ff2-2c8350e3a8d9 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5861cb08-0008-4b5f-8e1a-da118c1138f3 req-45a3015a-fc29-49b6-8ff2-2c8350e3a8d9 service nova] Lock "6907d670-3efe-473c-b03c-eb26c4b7ef4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-5861cb08-0008-4b5f-8e1a-da118c1138f3 req-45a3015a-fc29-49b6-8ff2-2c8350e3a8d9 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] No waiting events found dispatching network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:40 user nova-compute[73627]: WARNING nova.compute.manager [req-5861cb08-0008-4b5f-8e1a-da118c1138f3 req-45a3015a-fc29-49b6-8ff2-2c8350e3a8d9 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received unexpected event network-vif-plugged-7b801568-1011-4cc6-8a1b-b15d44abf741 for instance with vm_state deleted and task_state None.
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-5861cb08-0008-4b5f-8e1a-da118c1138f3 req-45a3015a-fc29-49b6-8ff2-2c8350e3a8d9 service nova] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Received event network-vif-deleted-7b801568-1011-4cc6-8a1b-b15d44abf741 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:40:40 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Creating image(s)
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Ensure instance console log exists: /opt/stack/data/nova/instances/e9e10c2f-8248-444e-a61a-e2997afde4a4/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Start _get_guest_xml network_info=[{"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewHBfLkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e9e10c2f-8248-444e-a61a-e2997afde4a4', 'attached_at': '', 'detached_at': '', 'volume_id': '54596b99-bdc8-424b-b5bf-55b05a660508', 'serial': '54596b99-bdc8-424b-b5bf-55b05a660508'}, 'guest_format': None, 'attachment_id': 'c7896e2c-4e83-4252-9eb9-b1fbe278b9fb', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:40:40 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:40:40 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewHBfLkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:40:40 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:40:40 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:40:40 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9c5faf-7dbe-400d-a07f-d24aa04eabe4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:40:40 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eaf313-1a66-475e-9378-152fd0ca6833]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508] added
Aug 26 16:40:40 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[513c994a-4296-4afa-b0aa-31b3d02de63c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f257c54-f521-45c7-8b00-84d18cdd9d08]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewHBfLkS {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewHBfLkS" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[736bb714-eb11-4374-98f9-66937c5315f8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewHBfLkS'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbafe87-6ac8-4329-90e2-3d7a9df5c0d2]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7899d287-44bf-4c63-a0e4-53602aae7751]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:40:40 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:40:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:40:40 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:40:40 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 16:40:40 user nova-compute[73627]: 
Aug 26 16:40:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[709d4bf0-9076-4866-87a1-5f5c6b9bb494]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260]
Aug 26 16:40:41 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260] successful.
Aug 26 16:40:41 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e609bf-1984-4e19-8e02-0edc277be811]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e51f9d-4e11-4a14-9f95-8f6641712b6a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:40:41 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:40:41 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ff7ccb-f13f-4dfa-a0bd-a01d9156c6c9]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:40:41 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewHBfLkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26239393263643031', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239393263643031', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-148211678',display_name='tempest-ServerActionsTestOtherA-server-148211678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-148211678',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPablajuq8xLBFiX0kjjyHTcUxoq8CZCKKmSQoF/n+RncsJGeKPTG3tFOgrEM0xDUb7dmLLfXVGvvH6d7PuXa2K1fYDVua5anrg1Gw7a6no9azLYSkiUBpYQ6yR/vuL6og==',key_name='tempest-keypair-1189535517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-4n7nlqag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=e9e10c2f-8248-444e-a61a-e2997afde4a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG nova.objects.instance [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'pci_devices' on Instance uuid e9e10c2f-8248-444e-a61a-e2997afde4a4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:40:42 user nova-compute[73627]:   <uuid>e9e10c2f-8248-444e-a61a-e2997afde4a4</uuid>
Aug 26 16:40:42 user nova-compute[73627]:   <name>instance-00000023</name>
Aug 26 16:40:42 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:40:42 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:40:42 user nova-compute[73627]:   <metadata>
Aug 26 16:40:42 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:40:42 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:40:42 user nova-compute[73627]:       <nova:name>tempest-ServerActionsTestOtherA-server-148211678</nova:name>
Aug 26 16:40:42 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:40:40</nova:creationTime>
Aug 26 16:40:42 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:40:42 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:40:42 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:40:42 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:40:42 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:40:42 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:40:42 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:40:42 user nova-compute[73627]:       <nova:owner>
Aug 26 16:40:42 user nova-compute[73627]:         <nova:user uuid="8945b1b1110e44568e0de86204d65e34">tempest-ServerActionsTestOtherA-1664197223-project-member</nova:user>
Aug 26 16:40:42 user nova-compute[73627]:         <nova:project uuid="3f8aed25a3184cf884a5774515d6d202">tempest-ServerActionsTestOtherA-1664197223</nova:project>
Aug 26 16:40:42 user nova-compute[73627]:       </nova:owner>
Aug 26 16:40:42 user nova-compute[73627]:       <nova:ports>
Aug 26 16:40:42 user nova-compute[73627]:         <nova:port uuid="67554b09-a82b-4a0b-8ff7-fb5e47c7031a">
Aug 26 16:40:42 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 16:40:42 user nova-compute[73627]:         </nova:port>
Aug 26 16:40:42 user nova-compute[73627]:       </nova:ports>
Aug 26 16:40:42 user nova-compute[73627]:     </nova:instance>
Aug 26 16:40:42 user nova-compute[73627]:   </metadata>
Aug 26 16:40:42 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:40:42 user nova-compute[73627]:     <system>
Aug 26 16:40:42 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:40:42 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:40:42 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:40:42 user nova-compute[73627]:       <entry name="serial">e9e10c2f-8248-444e-a61a-e2997afde4a4</entry>
Aug 26 16:40:42 user nova-compute[73627]:       <entry name="uuid">e9e10c2f-8248-444e-a61a-e2997afde4a4</entry>
Aug 26 16:40:42 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:40:42 user nova-compute[73627]:     </system>
Aug 26 16:40:42 user nova-compute[73627]:   </sysinfo>
Aug 26 16:40:42 user nova-compute[73627]:   <os>
Aug 26 16:40:42 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:40:42 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:40:42 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:40:42 user nova-compute[73627]:   </os>
Aug 26 16:40:42 user nova-compute[73627]:   <features>
Aug 26 16:40:42 user nova-compute[73627]:     <acpi/>
Aug 26 16:40:42 user nova-compute[73627]:     <apic/>
Aug 26 16:40:42 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:40:42 user nova-compute[73627]:   </features>
Aug 26 16:40:42 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:40:42 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:40:42 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:40:42 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:40:42 user nova-compute[73627]:   </clock>
Aug 26 16:40:42 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:40:42 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:40:42 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:40:42 user nova-compute[73627]:   </cpu>
Aug 26 16:40:42 user nova-compute[73627]:   <devices>
Aug 26 16:40:42 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:40:42 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:40:42 user nova-compute[73627]:       <source dev="/dev/sdb"/>
Aug 26 16:40:42 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:40:42 user nova-compute[73627]:       <serial>54596b99-bdc8-424b-b5bf-55b05a660508</serial>
Aug 26 16:40:42 user nova-compute[73627]:     </disk>
Aug 26 16:40:42 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:40:42 user nova-compute[73627]:       <mac address="fa:16:3e:5b:80:5d"/>
Aug 26 16:40:42 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:40:42 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:40:42 user nova-compute[73627]:       <target dev="tap67554b09-a8"/>
Aug 26 16:40:42 user nova-compute[73627]:     </interface>
Aug 26 16:40:42 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:40:42 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/e9e10c2f-8248-444e-a61a-e2997afde4a4/console.log" append="off"/>
Aug 26 16:40:42 user nova-compute[73627]:     </serial>
Aug 26 16:40:42 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:40:42 user nova-compute[73627]:     <video>
Aug 26 16:40:42 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:40:42 user nova-compute[73627]:     </video>
Aug 26 16:40:42 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:40:42 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:40:42 user nova-compute[73627]:     </rng>
Aug 26 16:40:42 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:40:42 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:40:42 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:40:42 user nova-compute[73627]:     </memballoon>
Aug 26 16:40:42 user nova-compute[73627]:   </devices>
Aug 26 16:40:42 user nova-compute[73627]: </domain>
Aug 26 16:40:42 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-148211678',display_name='tempest-ServerActionsTestOtherA-server-148211678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-148211678',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPablajuq8xLBFiX0kjjyHTcUxoq8CZCKKmSQoF/n+RncsJGeKPTG3tFOgrEM0xDUb7dmLLfXVGvvH6d7PuXa2K1fYDVua5anrg1Gw7a6no9azLYSkiUBpYQ6yR/vuL6og==',key_name='tempest-keypair-1189535517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-4n7nlqag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=e9e10c2f-8248-444e-a61a-e2997afde4a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG os_vif [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67554b09-a8, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67554b09-a8, col_values=(('external_ids', {'iface-id': '67554b09-a82b-4a0b-8ff7-fb5e47c7031a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:80:5d', 'vm-uuid': 'e9e10c2f-8248-444e-a61a-e2997afde4a4'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:42 user nova-compute[73627]: INFO os_vif [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8')
Aug 26 16:40:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:40:42 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No VIF found with MAC fa:16:3e:5b:80:5d, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:40:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-a8aee4cb-048e-46a4-a688-4dc8d6004521 req-036c4187-26d6-4a60-9a84-24c534cbabf0 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a8aee4cb-048e-46a4-a688-4dc8d6004521 req-036c4187-26d6-4a60-9a84-24c534cbabf0 service nova] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a8aee4cb-048e-46a4-a688-4dc8d6004521 req-036c4187-26d6-4a60-9a84-24c534cbabf0 service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a8aee4cb-048e-46a4-a688-4dc8d6004521 req-036c4187-26d6-4a60-9a84-24c534cbabf0 service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-a8aee4cb-048e-46a4-a688-4dc8d6004521 req-036c4187-26d6-4a60-9a84-24c534cbabf0 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] No waiting events found dispatching network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:43 user nova-compute[73627]: WARNING nova.compute.manager [req-a8aee4cb-048e-46a4-a688-4dc8d6004521 req-036c4187-26d6-4a60-9a84-24c534cbabf0 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received unexpected event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a for instance with vm_state building and task_state spawning.
Aug 26 16:40:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068045.7574499, e9e10c2f-8248-444e-a61a-e2997afde4a4 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:40:45 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] VM Resumed (Lifecycle Event)
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:40:45 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Instance spawned successfully.
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:40:45 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068045.7615364, e9e10c2f-8248-444e-a61a-e2997afde4a4 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:40:45 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] VM Started (Lifecycle Event)
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-ff8506d6-e24c-4315-b9b2-41c7a3c864b2 req-9301871f-5394-40f4-b713-a5248ae5f283 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ff8506d6-e24c-4315-b9b2-41c7a3c864b2 req-9301871f-5394-40f4-b713-a5248ae5f283 service nova] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ff8506d6-e24c-4315-b9b2-41c7a3c864b2 req-9301871f-5394-40f4-b713-a5248ae5f283 service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ff8506d6-e24c-4315-b9b2-41c7a3c864b2 req-9301871f-5394-40f4-b713-a5248ae5f283 service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.compute.manager [req-ff8506d6-e24c-4315-b9b2-41c7a3c864b2 req-9301871f-5394-40f4-b713-a5248ae5f283 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] No waiting events found dispatching network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:40:45 user nova-compute[73627]: WARNING nova.compute.manager [req-ff8506d6-e24c-4315-b9b2-41c7a3c864b2 req-9301871f-5394-40f4-b713-a5248ae5f283 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received unexpected event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a for instance with vm_state building and task_state spawning.
Aug 26 16:40:45 user nova-compute[73627]: INFO nova.compute.manager [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 26 16:40:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:40:45 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:40:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:45 user nova-compute[73627]: INFO nova.compute.manager [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Took 17.43 seconds to build instance.
Aug 26 16:40:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-d95815b5-e50f-4685-975a-8e35cb0bcf68 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.544s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:40:53 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068038.7138321, 6907d670-3efe-473c-b03c-eb26c4b7ef4e => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:40:53 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] VM Stopped (Lifecycle Event)
Aug 26 16:40:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-0064a24b-5fa0-488b-aa0f-ed41f2bd4eff None None] [instance: 6907d670-3efe-473c-b03c-eb26c4b7ef4e] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:40:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:40:59 user nova-compute[73627]: INFO nova.compute.claims [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Claim successful on node user
Aug 26 16:40:59 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG nova.network.neutron [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:40:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:40:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG nova.policy [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a676ca6fc331417d8f835ebcf8181cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c5a07134941420ba915917e23449851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:40:59 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Creating image(s)
Aug 26 16:40:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "/opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "/opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.044s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:40:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab.part --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Successfully created port: d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:41:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab.part --force-share --output=json" returned: 0 in 0.208s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:00 user nova-compute[73627]: DEBUG nova.virt.images [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] efe7a643-29f1-44d6-b009-64726366e933 was qcow2, converting to raw {{(pid=73627) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 16:41:00 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:41:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab.part /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab.converted {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab.part /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab.converted" returned: 0 in 0.465s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab.converted --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.450s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab --force-share --output=json" returned: 0 in 0.174s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab,backing_fmt=raw /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab,backing_fmt=raw /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk 1073741824" returned: 0 in 0.054s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG nova.network.neutron [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Successfully updated port: d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquired lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG nova.network.neutron [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-b84bda7c-f6e7-4517-a47b-0c4feaf247ab req-f0d53aff-3907-48aa-a476-f9ff0ba87a50 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-changed-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-b84bda7c-f6e7-4517-a47b-0c4feaf247ab req-f0d53aff-3907-48aa-a476-f9ff0ba87a50 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Refreshing instance network info cache due to event network-changed-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:41:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b84bda7c-f6e7-4517-a47b-0c4feaf247ab req-f0d53aff-3907-48aa-a476-f9ff0ba87a50 service nova] Acquiring lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.network.neutron [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Cannot resize image /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Ensure instance console log exists: /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.network.neutron [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updating instance_info_cache with network_info: [{"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Releasing lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Instance network_info: |[{"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b84bda7c-f6e7-4517-a47b-0c4feaf247ab req-f0d53aff-3907-48aa-a476-f9ff0ba87a50 service nova] Acquired lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.network.neutron [req-b84bda7c-f6e7-4517-a47b-0c4feaf247ab req-f0d53aff-3907-48aa-a476-f9ff0ba87a50 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Refreshing network info cache for port d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Start _get_guest_xml network_info=[{"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:40:56Z,direct_url=<?>,disk_format='qcow2',id=efe7a643-29f1-44d6-b009-64726366e933,min_disk=0,min_ram=0,name='tempest-scenario-img--1002581864',owner='0c5a07134941420ba915917e23449851',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:40:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': 'efe7a643-29f1-44d6-b009-64726366e933'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:41:02 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:41:02 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:40:56Z,direct_url=<?>,disk_format='qcow2',id=efe7a643-29f1-44d6-b009-64726366e933,min_disk=0,min_ram=0,name='tempest-scenario-img--1002581864',owner='0c5a07134941420ba915917e23449851',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:40:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-716097931',display_name='tempest-TestMinimumBasicScenario-server-716097931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-716097931',id=36,image_ref='efe7a643-29f1-44d6-b009-64726366e933',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFk4MdcqSuLzRBaShjQKxAFbPE2mLt4jSg3cw0bvfodEGADYPKGXoJpBn6Xv0rpN+FExFr5rNX3dRpjjunTbhYhSoaS+g3HeUj3AAFCHOLq71ODWpNJNLBudahFifz93A==',key_name='tempest-TestMinimumBasicScenario-467026074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c5a07134941420ba915917e23449851',ramdisk_id='',reservation_id='r-alrckhp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efe7a643-29f1-44d6-b009-64726366e933',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-808712581',owner_user_name='tempest-TestMinimumBasicScenario-808712581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:41:00Z,user_data=None,user_id='a676ca6fc331417d8f835ebcf8181cfb',uuid=0f18cdfa-972f-4f54-bf3b-8290a5407fd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converting VIF {"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:d4:68,bridge_name='br-int',has_traffic_filtering=True,id=d8ac6436-eeb9-479d-acc8-b244e8f7ceb4,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac6436-ee') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.objects.instance [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:41:02 user nova-compute[73627]:   <uuid>0f18cdfa-972f-4f54-bf3b-8290a5407fd2</uuid>
Aug 26 16:41:02 user nova-compute[73627]:   <name>instance-00000024</name>
Aug 26 16:41:02 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:41:02 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:41:02 user nova-compute[73627]:   <metadata>
Aug 26 16:41:02 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:41:02 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:41:02 user nova-compute[73627]:       <nova:name>tempest-TestMinimumBasicScenario-server-716097931</nova:name>
Aug 26 16:41:02 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:41:02</nova:creationTime>
Aug 26 16:41:02 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:41:02 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:41:02 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:41:02 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:41:02 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:41:02 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:41:02 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:41:02 user nova-compute[73627]:       <nova:owner>
Aug 26 16:41:02 user nova-compute[73627]:         <nova:user uuid="a676ca6fc331417d8f835ebcf8181cfb">tempest-TestMinimumBasicScenario-808712581-project-member</nova:user>
Aug 26 16:41:02 user nova-compute[73627]:         <nova:project uuid="0c5a07134941420ba915917e23449851">tempest-TestMinimumBasicScenario-808712581</nova:project>
Aug 26 16:41:02 user nova-compute[73627]:       </nova:owner>
Aug 26 16:41:02 user nova-compute[73627]:       <nova:root type="image" uuid="efe7a643-29f1-44d6-b009-64726366e933"/>
Aug 26 16:41:02 user nova-compute[73627]:       <nova:ports>
Aug 26 16:41:02 user nova-compute[73627]:         <nova:port uuid="d8ac6436-eeb9-479d-acc8-b244e8f7ceb4">
Aug 26 16:41:02 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 16:41:02 user nova-compute[73627]:         </nova:port>
Aug 26 16:41:02 user nova-compute[73627]:       </nova:ports>
Aug 26 16:41:02 user nova-compute[73627]:     </nova:instance>
Aug 26 16:41:02 user nova-compute[73627]:   </metadata>
Aug 26 16:41:02 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:41:02 user nova-compute[73627]:     <system>
Aug 26 16:41:02 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:41:02 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:41:02 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:41:02 user nova-compute[73627]:       <entry name="serial">0f18cdfa-972f-4f54-bf3b-8290a5407fd2</entry>
Aug 26 16:41:02 user nova-compute[73627]:       <entry name="uuid">0f18cdfa-972f-4f54-bf3b-8290a5407fd2</entry>
Aug 26 16:41:02 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:41:02 user nova-compute[73627]:     </system>
Aug 26 16:41:02 user nova-compute[73627]:   </sysinfo>
Aug 26 16:41:02 user nova-compute[73627]:   <os>
Aug 26 16:41:02 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:41:02 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:41:02 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:41:02 user nova-compute[73627]:   </os>
Aug 26 16:41:02 user nova-compute[73627]:   <features>
Aug 26 16:41:02 user nova-compute[73627]:     <acpi/>
Aug 26 16:41:02 user nova-compute[73627]:     <apic/>
Aug 26 16:41:02 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:41:02 user nova-compute[73627]:   </features>
Aug 26 16:41:02 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:41:02 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:41:02 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:41:02 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:41:02 user nova-compute[73627]:   </clock>
Aug 26 16:41:02 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:41:02 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:41:02 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:41:02 user nova-compute[73627]:   </cpu>
Aug 26 16:41:02 user nova-compute[73627]:   <devices>
Aug 26 16:41:02 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:41:02 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:41:02 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk"/>
Aug 26 16:41:02 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:41:02 user nova-compute[73627]:     </disk>
Aug 26 16:41:02 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:41:02 user nova-compute[73627]:       <mac address="fa:16:3e:77:d4:68"/>
Aug 26 16:41:02 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:41:02 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:41:02 user nova-compute[73627]:       <target dev="tapd8ac6436-ee"/>
Aug 26 16:41:02 user nova-compute[73627]:     </interface>
Aug 26 16:41:02 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:41:02 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/console.log" append="off"/>
Aug 26 16:41:02 user nova-compute[73627]:     </serial>
Aug 26 16:41:02 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:41:02 user nova-compute[73627]:     <video>
Aug 26 16:41:02 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:41:02 user nova-compute[73627]:     </video>
Aug 26 16:41:02 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:41:02 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:41:02 user nova-compute[73627]:     </rng>
Aug 26 16:41:02 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:41:02 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:41:02 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:41:02 user nova-compute[73627]:     </memballoon>
Aug 26 16:41:02 user nova-compute[73627]:   </devices>
Aug 26 16:41:02 user nova-compute[73627]: </domain>
Aug 26 16:41:02 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-716097931',display_name='tempest-TestMinimumBasicScenario-server-716097931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-716097931',id=36,image_ref='efe7a643-29f1-44d6-b009-64726366e933',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFk4MdcqSuLzRBaShjQKxAFbPE2mLt4jSg3cw0bvfodEGADYPKGXoJpBn6Xv0rpN+FExFr5rNX3dRpjjunTbhYhSoaS+g3HeUj3AAFCHOLq71ODWpNJNLBudahFifz93A==',key_name='tempest-TestMinimumBasicScenario-467026074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c5a07134941420ba915917e23449851',ramdisk_id='',reservation_id='r-alrckhp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efe7a643-29f1-44d6-b009-64726366e933',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-808712581',owner_user_name='tempest-TestMinimumBasicScenario-808712581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:41:00Z,user_data=None,user_id='a676ca6fc331417d8f835ebcf8181cfb',uuid=0f18cdfa-972f-4f54-bf3b-8290a5407fd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converting VIF {"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:d4:68,bridge_name='br-int',has_traffic_filtering=True,id=d8ac6436-eeb9-479d-acc8-b244e8f7ceb4,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac6436-ee') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG os_vif [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:d4:68,bridge_name='br-int',has_traffic_filtering=True,id=d8ac6436-eeb9-479d-acc8-b244e8f7ceb4,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac6436-ee') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8ac6436-ee, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8ac6436-ee, col_values=(('external_ids', {'iface-id': 'd8ac6436-eeb9-479d-acc8-b244e8f7ceb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:d4:68', 'vm-uuid': '0f18cdfa-972f-4f54-bf3b-8290a5407fd2'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:02 user nova-compute[73627]: INFO os_vif [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:d4:68,bridge_name='br-int',has_traffic_filtering=True,id=d8ac6436-eeb9-479d-acc8-b244e8f7ceb4,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac6436-ee')
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] No VIF found with MAC fa:16:3e:77:d4:68, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.network.neutron [req-b84bda7c-f6e7-4517-a47b-0c4feaf247ab req-f0d53aff-3907-48aa-a476-f9ff0ba87a50 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updated VIF entry in instance network info cache for port d8ac6436-eeb9-479d-acc8-b244e8f7ceb4. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG nova.network.neutron [req-b84bda7c-f6e7-4517-a47b-0c4feaf247ab req-f0d53aff-3907-48aa-a476-f9ff0ba87a50 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updating instance_info_cache with network_info: [{"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:41:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b84bda7c-f6e7-4517-a47b-0c4feaf247ab req-f0d53aff-3907-48aa-a476-f9ff0ba87a50 service nova] Releasing lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:41:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-1e54e44d-e500-4da0-8b93-a682dfc0fad5 req-fe6614ec-626d-44fd-bb37-ea1f28c0bec7 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1e54e44d-e500-4da0-8b93-a682dfc0fad5 req-fe6614ec-626d-44fd-bb37-ea1f28c0bec7 service nova] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1e54e44d-e500-4da0-8b93-a682dfc0fad5 req-fe6614ec-626d-44fd-bb37-ea1f28c0bec7 service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1e54e44d-e500-4da0-8b93-a682dfc0fad5 req-fe6614ec-626d-44fd-bb37-ea1f28c0bec7 service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-1e54e44d-e500-4da0-8b93-a682dfc0fad5 req-fe6614ec-626d-44fd-bb37-ea1f28c0bec7 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] No waiting events found dispatching network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:41:04 user nova-compute[73627]: WARNING nova.compute.manager [req-1e54e44d-e500-4da0-8b93-a682dfc0fad5 req-fe6614ec-626d-44fd-bb37-ea1f28c0bec7 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received unexpected event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 for instance with vm_state building and task_state spawning.
Aug 26 16:41:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-c4778adf-7f93-4870-b606-c60f13313ed7 req-8787e6d1-1d52-430a-af44-daec93e0dd5f service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4778adf-7f93-4870-b606-c60f13313ed7 req-8787e6d1-1d52-430a-af44-daec93e0dd5f service nova] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4778adf-7f93-4870-b606-c60f13313ed7 req-8787e6d1-1d52-430a-af44-daec93e0dd5f service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c4778adf-7f93-4870-b606-c60f13313ed7 req-8787e6d1-1d52-430a-af44-daec93e0dd5f service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-c4778adf-7f93-4870-b606-c60f13313ed7 req-8787e6d1-1d52-430a-af44-daec93e0dd5f service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] No waiting events found dispatching network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:41:06 user nova-compute[73627]: WARNING nova.compute.manager [req-c4778adf-7f93-4870-b606-c60f13313ed7 req-8787e6d1-1d52-430a-af44-daec93e0dd5f service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received unexpected event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 for instance with vm_state building and task_state spawning.
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068066.776899, 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:41:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] VM Resumed (Lifecycle Event)
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:41:06 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Instance spawned successfully.
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068066.7790275, 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:41:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] VM Started (Lifecycle Event)
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:41:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:41:06 user nova-compute[73627]: INFO nova.compute.manager [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 26 16:41:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:41:07 user nova-compute[73627]: INFO nova.compute.manager [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Took 7.72 seconds to build instance.
Aug 26 16:41:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-67f26e13-932c-410d-9051-d871d6b54439 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.888s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:41:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:41:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:41:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:41:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:14 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:41:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:16 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:41:16 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:41:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=7951MB free_disk=25.338775634765625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 3793d67f-b6a0-4eba-8f26-8358e30f12d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 98114285-9c1d-4ff4-9121-77bd1a798200 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance e9e10c2f-8248-444e-a61a-e2997afde4a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:41:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:41:17 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:41:17 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:41:17 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:41:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Acquiring lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Acquiring lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:19 user nova-compute[73627]: INFO nova.compute.manager [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Terminating instance
Aug 26 16:41:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbdd6ad2-69ec-47ef-99d0-8712a28b640f req-7b84fc4f-95b9-44bb-8a3e-95ea7f8caa7a service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Received event network-vif-unplugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbdd6ad2-69ec-47ef-99d0-8712a28b640f req-7b84fc4f-95b9-44bb-8a3e-95ea7f8caa7a service nova] Acquiring lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbdd6ad2-69ec-47ef-99d0-8712a28b640f req-7b84fc4f-95b9-44bb-8a3e-95ea7f8caa7a service nova] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dbdd6ad2-69ec-47ef-99d0-8712a28b640f req-7b84fc4f-95b9-44bb-8a3e-95ea7f8caa7a service nova] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbdd6ad2-69ec-47ef-99d0-8712a28b640f req-7b84fc4f-95b9-44bb-8a3e-95ea7f8caa7a service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] No waiting events found dispatching network-vif-unplugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-dbdd6ad2-69ec-47ef-99d0-8712a28b640f req-7b84fc4f-95b9-44bb-8a3e-95ea7f8caa7a service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Received event network-vif-unplugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 16:41:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Instance destroyed successfully.
Aug 26 16:41:19 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lazy-loading 'resources' on Instance uuid 3793d67f-b6a0-4eba-8f26-8358e30f12d6 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:39:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-604323559',display_name='tempest-VolumesNegativeTest-instance-604323559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-604323559',id=34,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:39:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62aa43aded4a47faa2aeaefdb17a76bd',ramdisk_id='',reservation_id='r-ht7esidh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1562346038',owner_user_name='tempest-VolumesNegativeTest-1562346038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:39:37Z,user_data=None,user_id='e69ce035b143416e9fd443d8a0b88a04',uuid=3793d67f-b6a0-4eba-8f26-8358e30f12d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "address": "fa:16:3e:43:55:bb", "network": {"id": "65db01d6-9f50-44a8-a81d-09c4a4eeac15", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a7c6cc558f914e288686b7d529eb93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbd1e00-77", "ovs_interfaceid": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Converting VIF {"id": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "address": "fa:16:3e:43:55:bb", "network": {"id": "65db01d6-9f50-44a8-a81d-09c4a4eeac15", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a7c6cc558f914e288686b7d529eb93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fbd1e00-77", "ovs_interfaceid": "3fbd1e00-7723-461b-ab12-a26d6d5985cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=3fbd1e00-7723-461b-ab12-a26d6d5985cb,network=Network(65db01d6-9f50-44a8-a81d-09c4a4eeac15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbd1e00-77') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG os_vif [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=3fbd1e00-7723-461b-ab12-a26d6d5985cb,network=Network(65db01d6-9f50-44a8-a81d-09c4a4eeac15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbd1e00-77') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fbd1e00-77, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:19 user nova-compute[73627]: INFO os_vif [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:55:bb,bridge_name='br-int',has_traffic_filtering=True,id=3fbd1e00-7723-461b-ab12-a26d6d5985cb,network=Network(65db01d6-9f50-44a8-a81d-09c4a4eeac15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fbd1e00-77')
Aug 26 16:41:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Deleting instance files /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6_del
Aug 26 16:41:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Deletion of /opt/stack/data/nova/instances/3793d67f-b6a0-4eba-8f26-8358e30f12d6_del complete
Aug 26 16:41:20 user nova-compute[73627]: INFO nova.compute.manager [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Took 0.76 seconds to destroy the instance on the hypervisor.
Aug 26 16:41:20 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:41:20 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:41:20 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:41:20 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:41:20 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Took 0.62 seconds to deallocate network for instance.
Aug 26 16:41:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:41:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:20 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:41:20 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:41:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:20 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Deleted allocations for instance 3793d67f-b6a0-4eba-8f26-8358e30f12d6
Aug 26 16:41:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b3e15ef6-c5b3-40d6-9edc-ba317931f77e tempest-VolumesNegativeTest-1562346038 tempest-VolumesNegativeTest-1562346038-project-member] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-c63e83f2-3b12-41c4-80a5-5bed90b9a380 req-0e5b0494-fae6-40ec-b8f8-6c6353881951 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Received event network-vif-plugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c63e83f2-3b12-41c4-80a5-5bed90b9a380 req-0e5b0494-fae6-40ec-b8f8-6c6353881951 service nova] Acquiring lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c63e83f2-3b12-41c4-80a5-5bed90b9a380 req-0e5b0494-fae6-40ec-b8f8-6c6353881951 service nova] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c63e83f2-3b12-41c4-80a5-5bed90b9a380 req-0e5b0494-fae6-40ec-b8f8-6c6353881951 service nova] Lock "3793d67f-b6a0-4eba-8f26-8358e30f12d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-c63e83f2-3b12-41c4-80a5-5bed90b9a380 req-0e5b0494-fae6-40ec-b8f8-6c6353881951 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] No waiting events found dispatching network-vif-plugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:41:21 user nova-compute[73627]: WARNING nova.compute.manager [req-c63e83f2-3b12-41c4-80a5-5bed90b9a380 req-0e5b0494-fae6-40ec-b8f8-6c6353881951 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Received unexpected event network-vif-plugged-3fbd1e00-7723-461b-ab12-a26d6d5985cb for instance with vm_state deleted and task_state None.
Aug 26 16:41:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-c63e83f2-3b12-41c4-80a5-5bed90b9a380 req-0e5b0494-fae6-40ec-b8f8-6c6353881951 service nova] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Received event network-vif-deleted-3fbd1e00-7723-461b-ab12-a26d6d5985cb {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:21 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:41:21 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:41:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "61758740-6a39-4e9b-9e52-5680505a3d94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "61758740-6a39-4e9b-9e52-5680505a3d94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:41:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:41:22 user nova-compute[73627]: INFO nova.compute.claims [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Claim successful on node user
Aug 26 16:41:23 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:41:23 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:41:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG nova.policy [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65e9557ef8a44c1dbd6f3889f3dd3586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fa96cd11e64d2083b9ce6f331ac19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:41:23 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Creating image(s)
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "/opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "/opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "/opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.206s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk 1073741824" returned: 0 in 0.060s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.294s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Cannot resize image /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Ensure instance console log exists: /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Successfully created port: 5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:41:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Successfully updated port: 5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "refresh_cache-61758740-6a39-4e9b-9e52-5680505a3d94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquired lock "refresh_cache-61758740-6a39-4e9b-9e52-5680505a3d94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-8537840b-2cd8-44ad-980c-e658f0e3aa7a req-ea7e6729-2a85-48c8-9f06-e2574d3a5c85 service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Received event network-changed-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-8537840b-2cd8-44ad-980c-e658f0e3aa7a req-ea7e6729-2a85-48c8-9f06-e2574d3a5c85 service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Refreshing instance network info cache due to event network-changed-5f9c284b-67d6-437f-a94a-e9f1d7dc7539. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8537840b-2cd8-44ad-980c-e658f0e3aa7a req-ea7e6729-2a85-48c8-9f06-e2574d3a5c85 service nova] Acquiring lock "refresh_cache-61758740-6a39-4e9b-9e52-5680505a3d94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Updating instance_info_cache with network_info: [{"id": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "address": "fa:16:3e:90:c6:64", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9c284b-67", "ovs_interfaceid": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Releasing lock "refresh_cache-61758740-6a39-4e9b-9e52-5680505a3d94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Instance network_info: |[{"id": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "address": "fa:16:3e:90:c6:64", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9c284b-67", "ovs_interfaceid": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8537840b-2cd8-44ad-980c-e658f0e3aa7a req-ea7e6729-2a85-48c8-9f06-e2574d3a5c85 service nova] Acquired lock "refresh_cache-61758740-6a39-4e9b-9e52-5680505a3d94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.network.neutron [req-8537840b-2cd8-44ad-980c-e658f0e3aa7a req-ea7e6729-2a85-48c8-9f06-e2574d3a5c85 service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Refreshing network info cache for port 5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Start _get_guest_xml network_info=[{"id": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "address": "fa:16:3e:90:c6:64", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9c284b-67", "ovs_interfaceid": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:41:25 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:41:25 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1421601558',display_name='tempest-VolumesActionsTest-instance-1421601558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1421601558',id=37,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fa96cd11e64d2083b9ce6f331ac19c',ramdisk_id='',reservation_id='r-7i8921oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1696244677',owner_user_name='tempest-VolumesActionsTest-1696244677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:41:23Z,user_data=None,user_id='65e9557ef8a44c1dbd6f3889f3dd3586',uuid=61758740-6a39-4e9b-9e52-5680505a3d94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "address": "fa:16:3e:90:c6:64", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9c284b-67", "ovs_interfaceid": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converting VIF {"id": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "address": "fa:16:3e:90:c6:64", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9c284b-67", "ovs_interfaceid": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9c284b-67d6-437f-a94a-e9f1d7dc7539,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9c284b-67') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.objects.instance [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lazy-loading 'pci_devices' on Instance uuid 61758740-6a39-4e9b-9e52-5680505a3d94 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:41:25 user nova-compute[73627]:   <uuid>61758740-6a39-4e9b-9e52-5680505a3d94</uuid>
Aug 26 16:41:25 user nova-compute[73627]:   <name>instance-00000025</name>
Aug 26 16:41:25 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:41:25 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:41:25 user nova-compute[73627]:   <metadata>
Aug 26 16:41:25 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:41:25 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:41:25 user nova-compute[73627]:       <nova:name>tempest-VolumesActionsTest-instance-1421601558</nova:name>
Aug 26 16:41:25 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:41:25</nova:creationTime>
Aug 26 16:41:25 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:41:25 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:41:25 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:41:25 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:41:25 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:41:25 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:41:25 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:41:25 user nova-compute[73627]:       <nova:owner>
Aug 26 16:41:25 user nova-compute[73627]:         <nova:user uuid="65e9557ef8a44c1dbd6f3889f3dd3586">tempest-VolumesActionsTest-1696244677-project-member</nova:user>
Aug 26 16:41:25 user nova-compute[73627]:         <nova:project uuid="06fa96cd11e64d2083b9ce6f331ac19c">tempest-VolumesActionsTest-1696244677</nova:project>
Aug 26 16:41:25 user nova-compute[73627]:       </nova:owner>
Aug 26 16:41:25 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:41:25 user nova-compute[73627]:       <nova:ports>
Aug 26 16:41:25 user nova-compute[73627]:         <nova:port uuid="5f9c284b-67d6-437f-a94a-e9f1d7dc7539">
Aug 26 16:41:25 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 16:41:25 user nova-compute[73627]:         </nova:port>
Aug 26 16:41:25 user nova-compute[73627]:       </nova:ports>
Aug 26 16:41:25 user nova-compute[73627]:     </nova:instance>
Aug 26 16:41:25 user nova-compute[73627]:   </metadata>
Aug 26 16:41:25 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:41:25 user nova-compute[73627]:     <system>
Aug 26 16:41:25 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:41:25 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:41:25 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:41:25 user nova-compute[73627]:       <entry name="serial">61758740-6a39-4e9b-9e52-5680505a3d94</entry>
Aug 26 16:41:25 user nova-compute[73627]:       <entry name="uuid">61758740-6a39-4e9b-9e52-5680505a3d94</entry>
Aug 26 16:41:25 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:41:25 user nova-compute[73627]:     </system>
Aug 26 16:41:25 user nova-compute[73627]:   </sysinfo>
Aug 26 16:41:25 user nova-compute[73627]:   <os>
Aug 26 16:41:25 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:41:25 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:41:25 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:41:25 user nova-compute[73627]:   </os>
Aug 26 16:41:25 user nova-compute[73627]:   <features>
Aug 26 16:41:25 user nova-compute[73627]:     <acpi/>
Aug 26 16:41:25 user nova-compute[73627]:     <apic/>
Aug 26 16:41:25 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:41:25 user nova-compute[73627]:   </features>
Aug 26 16:41:25 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:41:25 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:41:25 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:41:25 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:41:25 user nova-compute[73627]:   </clock>
Aug 26 16:41:25 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:41:25 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:41:25 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:41:25 user nova-compute[73627]:   </cpu>
Aug 26 16:41:25 user nova-compute[73627]:   <devices>
Aug 26 16:41:25 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:41:25 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:41:25 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk"/>
Aug 26 16:41:25 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:41:25 user nova-compute[73627]:     </disk>
Aug 26 16:41:25 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:41:25 user nova-compute[73627]:       <mac address="fa:16:3e:90:c6:64"/>
Aug 26 16:41:25 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:41:25 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:41:25 user nova-compute[73627]:       <target dev="tap5f9c284b-67"/>
Aug 26 16:41:25 user nova-compute[73627]:     </interface>
Aug 26 16:41:25 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:41:25 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/console.log" append="off"/>
Aug 26 16:41:25 user nova-compute[73627]:     </serial>
Aug 26 16:41:25 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:41:25 user nova-compute[73627]:     <video>
Aug 26 16:41:25 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:41:25 user nova-compute[73627]:     </video>
Aug 26 16:41:25 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:41:25 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:41:25 user nova-compute[73627]:     </rng>
Aug 26 16:41:25 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:41:25 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:41:25 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:41:25 user nova-compute[73627]:     </memballoon>
Aug 26 16:41:25 user nova-compute[73627]:   </devices>
Aug 26 16:41:25 user nova-compute[73627]: </domain>
Aug 26 16:41:25 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1421601558',display_name='tempest-VolumesActionsTest-instance-1421601558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1421601558',id=37,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fa96cd11e64d2083b9ce6f331ac19c',ramdisk_id='',reservation_id='r-7i8921oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1696244677',owner_user_name='tempest-VolumesActionsTest-1696244677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:41:23Z,user_data=None,user_id='65e9557ef8a44c1dbd6f3889f3dd3586',uuid=61758740-6a39-4e9b-9e52-5680505a3d94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "address": "fa:16:3e:90:c6:64", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9c284b-67", "ovs_interfaceid": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converting VIF {"id": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "address": "fa:16:3e:90:c6:64", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9c284b-67", "ovs_interfaceid": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9c284b-67d6-437f-a94a-e9f1d7dc7539,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9c284b-67') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG os_vif [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9c284b-67d6-437f-a94a-e9f1d7dc7539,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9c284b-67') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f9c284b-67, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f9c284b-67, col_values=(('external_ids', {'iface-id': '5f9c284b-67d6-437f-a94a-e9f1d7dc7539', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:c6:64', 'vm-uuid': '61758740-6a39-4e9b-9e52-5680505a3d94'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:25 user nova-compute[73627]: INFO os_vif [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9c284b-67d6-437f-a94a-e9f1d7dc7539,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9c284b-67')
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:41:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] No VIF found with MAC fa:16:3e:90:c6:64, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:41:26 user nova-compute[73627]: DEBUG nova.network.neutron [req-8537840b-2cd8-44ad-980c-e658f0e3aa7a req-ea7e6729-2a85-48c8-9f06-e2574d3a5c85 service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Updated VIF entry in instance network info cache for port 5f9c284b-67d6-437f-a94a-e9f1d7dc7539. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:41:26 user nova-compute[73627]: DEBUG nova.network.neutron [req-8537840b-2cd8-44ad-980c-e658f0e3aa7a req-ea7e6729-2a85-48c8-9f06-e2574d3a5c85 service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Updating instance_info_cache with network_info: [{"id": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "address": "fa:16:3e:90:c6:64", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9c284b-67", "ovs_interfaceid": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:41:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8537840b-2cd8-44ad-980c-e658f0e3aa7a req-ea7e6729-2a85-48c8-9f06-e2574d3a5c85 service nova] Releasing lock "refresh_cache-61758740-6a39-4e9b-9e52-5680505a3d94" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:41:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-45c903d1-7c0d-4f21-a03e-1c7a8366dfc2 req-3342b6be-2e35-421a-9f6d-e552961aebda service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Received event network-vif-plugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-45c903d1-7c0d-4f21-a03e-1c7a8366dfc2 req-3342b6be-2e35-421a-9f6d-e552961aebda service nova] Acquiring lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-45c903d1-7c0d-4f21-a03e-1c7a8366dfc2 req-3342b6be-2e35-421a-9f6d-e552961aebda service nova] Lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-45c903d1-7c0d-4f21-a03e-1c7a8366dfc2 req-3342b6be-2e35-421a-9f6d-e552961aebda service nova] Lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-45c903d1-7c0d-4f21-a03e-1c7a8366dfc2 req-3342b6be-2e35-421a-9f6d-e552961aebda service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] No waiting events found dispatching network-vif-plugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:41:27 user nova-compute[73627]: WARNING nova.compute.manager [req-45c903d1-7c0d-4f21-a03e-1c7a8366dfc2 req-3342b6be-2e35-421a-9f6d-e552961aebda service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Received unexpected event network-vif-plugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 for instance with vm_state building and task_state spawning.
Aug 26 16:41:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068089.526515, 61758740-6a39-4e9b-9e52-5680505a3d94 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:41:29 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] VM Resumed (Lifecycle Event)
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:41:29 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Instance spawned successfully.
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:41:29 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068089.5357187, 61758740-6a39-4e9b-9e52-5680505a3d94 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:41:29 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] VM Started (Lifecycle Event)
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:41:29 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:41:29 user nova-compute[73627]: INFO nova.compute.manager [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Took 6.22 seconds to spawn the instance on the hypervisor.
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:41:29 user nova-compute[73627]: INFO nova.compute.manager [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Took 6.86 seconds to build instance.
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-123573d0-ee20-481c-9c39-8972c8d22e15 req-cecdf111-369c-456d-9cec-7c5f7d5ed64c service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Received event network-vif-plugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-123573d0-ee20-481c-9c39-8972c8d22e15 req-cecdf111-369c-456d-9cec-7c5f7d5ed64c service nova] Acquiring lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-123573d0-ee20-481c-9c39-8972c8d22e15 req-cecdf111-369c-456d-9cec-7c5f7d5ed64c service nova] Lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-123573d0-ee20-481c-9c39-8972c8d22e15 req-cecdf111-369c-456d-9cec-7c5f7d5ed64c service nova] Lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-123573d0-ee20-481c-9c39-8972c8d22e15 req-cecdf111-369c-456d-9cec-7c5f7d5ed64c service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] No waiting events found dispatching network-vif-plugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:41:29 user nova-compute[73627]: WARNING nova.compute.manager [req-123573d0-ee20-481c-9c39-8972c8d22e15 req-cecdf111-369c-456d-9cec-7c5f7d5ed64c service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Received unexpected event network-vif-plugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 for instance with vm_state active and task_state None.
Aug 26 16:41:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1ecaa742-f94c-4155-b2ca-48752b48c6e6 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "61758740-6a39-4e9b-9e52-5680505a3d94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.947s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:34 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068079.8639917, 3793d67f-b6a0-4eba-8f26-8358e30f12d6 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:41:34 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] VM Stopped (Lifecycle Event)
Aug 26 16:41:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-05af8887-3c1a-4ee7-89aa-f54531f04807 None None] [instance: 3793d67f-b6a0-4eba-8f26-8358e30f12d6] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:41:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:41:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "98114285-9c1d-4ff4-9121-77bd1a798200" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:54 user nova-compute[73627]: INFO nova.compute.manager [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Terminating instance
Aug 26 16:41:54 user nova-compute[73627]: DEBUG nova.compute.manager [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-13680319-bb96-49d0-8138-2a86d3b024d1 req-db81049a-44e4-4f66-91d8-eb009acc7f37 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-vif-unplugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-13680319-bb96-49d0-8138-2a86d3b024d1 req-db81049a-44e4-4f66-91d8-eb009acc7f37 service nova] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-13680319-bb96-49d0-8138-2a86d3b024d1 req-db81049a-44e4-4f66-91d8-eb009acc7f37 service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-13680319-bb96-49d0-8138-2a86d3b024d1 req-db81049a-44e4-4f66-91d8-eb009acc7f37 service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-13680319-bb96-49d0-8138-2a86d3b024d1 req-db81049a-44e4-4f66-91d8-eb009acc7f37 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] No waiting events found dispatching network-vif-unplugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:41:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-13680319-bb96-49d0-8138-2a86d3b024d1 req-db81049a-44e4-4f66-91d8-eb009acc7f37 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-vif-unplugged-8437f747-1797-4480-9ad4-52e88581f6c1 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:41:55 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Instance destroyed successfully.
Aug 26 16:41:55 user nova-compute[73627]: DEBUG nova.objects.instance [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lazy-loading 'resources' on Instance uuid 98114285-9c1d-4ff4-9121-77bd1a798200 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:41:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T16:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-233452645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-233452645',id=32,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0ddVKlODQpyHh4KT4LZnVXn94T1Lwdm0PnrfafPY1hWmK4SZJYuJRT2e+F5UcAOCxUPzvz/BqVEYfiayi4QRZCRWncJwCoDfzYVAWf8qI/e1XQvBI3Fbb4ZetPPf9gWA==',key_name='tempest-keypair-9464290',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93acb667ea194ce4b6f55e4e86fe9f5c',ramdisk_id='',reservation_id='r-ln08v5k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2118968964',owner_user_name='tempest-AttachVolumeShelveTestJSON-2118968964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:40:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c01a881f130f4cbe9c70e2acd4842b8d',uuid=98114285-9c1d-4ff4-9121-77bd1a798200,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:41:55 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converting VIF {"id": "8437f747-1797-4480-9ad4-52e88581f6c1", "address": "fa:16:3e:a0:1d:97", "network": {"id": "cda1dee9-4737-4721-a3a3-33cd77e8f7e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1872751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93acb667ea194ce4b6f55e4e86fe9f5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8437f747-17", "ovs_interfaceid": "8437f747-1797-4480-9ad4-52e88581f6c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:41:55 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:41:55 user nova-compute[73627]: DEBUG os_vif [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:41:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8437f747-17, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:41:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:41:55 user nova-compute[73627]: INFO os_vif [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:97,bridge_name='br-int',has_traffic_filtering=True,id=8437f747-1797-4480-9ad4-52e88581f6c1,network=Network(cda1dee9-4737-4721-a3a3-33cd77e8f7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8437f747-17')
Aug 26 16:41:55 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Deleting instance files /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200_del
Aug 26 16:41:55 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Deletion of /opt/stack/data/nova/instances/98114285-9c1d-4ff4-9121-77bd1a798200_del complete
Aug 26 16:41:55 user nova-compute[73627]: INFO nova.compute.manager [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 26 16:41:55 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:41:55 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:41:55 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:41:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:41:56 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Took 0.99 seconds to deallocate network for instance.
Aug 26 16:41:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-4233cc74-f871-40b7-9163-7525f0466cbb req-6bd5e9c5-9dde-41c1-bc59-e39db4258d76 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-vif-deleted-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:56 user nova-compute[73627]: INFO nova.compute.manager [req-4233cc74-f871-40b7-9163-7525f0466cbb req-6bd5e9c5-9dde-41c1-bc59-e39db4258d76 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Neutron deleted interface 8437f747-1797-4480-9ad4-52e88581f6c1; detaching it from the instance and deleting it from the info cache
Aug 26 16:41:56 user nova-compute[73627]: DEBUG nova.network.neutron [req-4233cc74-f871-40b7-9163-7525f0466cbb req-6bd5e9c5-9dde-41c1-bc59-e39db4258d76 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-4233cc74-f871-40b7-9163-7525f0466cbb req-6bd5e9c5-9dde-41c1-bc59-e39db4258d76 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Detach interface failed, port_id=8437f747-1797-4480-9ad4-52e88581f6c1, reason: Instance 98114285-9c1d-4ff4-9121-77bd1a798200 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:56 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Deleted allocations for instance 98114285-9c1d-4ff4-9121-77bd1a798200
Aug 26 16:41:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-69b96bef-6528-4f3b-a31a-4b400dd7fac8 tempest-AttachVolumeShelveTestJSON-2118968964 tempest-AttachVolumeShelveTestJSON-2118968964-project-member] Lock "98114285-9c1d-4ff4-9121-77bd1a798200" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.207s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-dc425213-2073-486e-af44-bbd59b6819dc req-2122d361-36f9-43e3-bffc-cffdcb900fb8 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dc425213-2073-486e-af44-bbd59b6819dc req-2122d361-36f9-43e3-bffc-cffdcb900fb8 service nova] Acquiring lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dc425213-2073-486e-af44-bbd59b6819dc req-2122d361-36f9-43e3-bffc-cffdcb900fb8 service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dc425213-2073-486e-af44-bbd59b6819dc req-2122d361-36f9-43e3-bffc-cffdcb900fb8 service nova] Lock "98114285-9c1d-4ff4-9121-77bd1a798200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:41:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-dc425213-2073-486e-af44-bbd59b6819dc req-2122d361-36f9-43e3-bffc-cffdcb900fb8 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] No waiting events found dispatching network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:41:56 user nova-compute[73627]: WARNING nova.compute.manager [req-dc425213-2073-486e-af44-bbd59b6819dc req-2122d361-36f9-43e3-bffc-cffdcb900fb8 service nova] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Received unexpected event network-vif-plugged-8437f747-1797-4480-9ad4-52e88581f6c1 for instance with vm_state deleted and task_state None.
Aug 26 16:42:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:10 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068115.0627606, 98114285-9c1d-4ff4-9121-77bd1a798200 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:42:10 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] VM Stopped (Lifecycle Event)
Aug 26 16:42:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-046c4d1b-d61c-44a8-b262-62a81b40a637 None None] [instance: 98114285-9c1d-4ff4-9121-77bd1a798200] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:42:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:42:10 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:42:13 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:42:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:42:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:42:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:42:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:42:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:42:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:42:16 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:42:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:42:16 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:18 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:42:18 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:42:18 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8155MB free_disk=25.32550048828125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance e9e10c2f-8248-444e-a61a-e2997afde4a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 61758740-6a39-4e9b-9e52-5680505a3d94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:42:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:42:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-0e43b0c8-e0ec-4106-bd70-fbd73ecd5f35 req-2c6525c6-dac4-49f9-b418-f51db32214f6 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-changed-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:42:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-0e43b0c8-e0ec-4106-bd70-fbd73ecd5f35 req-2c6525c6-dac4-49f9-b418-f51db32214f6 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Refreshing instance network info cache due to event network-changed-9c451176-da07-49b3-8a14-03f62ec16298. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:42:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0e43b0c8-e0ec-4106-bd70-fbd73ecd5f35 req-2c6525c6-dac4-49f9-b418-f51db32214f6 service nova] Acquiring lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:42:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0e43b0c8-e0ec-4106-bd70-fbd73ecd5f35 req-2c6525c6-dac4-49f9-b418-f51db32214f6 service nova] Acquired lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:42:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-0e43b0c8-e0ec-4106-bd70-fbd73ecd5f35 req-2c6525c6-dac4-49f9-b418-f51db32214f6 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Refreshing network info cache for port 9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:42:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:42:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:42:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:42:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:42:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-0e43b0c8-e0ec-4106-bd70-fbd73ecd5f35 req-2c6525c6-dac4-49f9-b418-f51db32214f6 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updated VIF entry in instance network info cache for port 9c451176-da07-49b3-8a14-03f62ec16298. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:42:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-0e43b0c8-e0ec-4106-bd70-fbd73ecd5f35 req-2c6525c6-dac4-49f9-b418-f51db32214f6 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updating instance_info_cache with network_info: [{"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:42:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0e43b0c8-e0ec-4106-bd70-fbd73ecd5f35 req-2c6525c6-dac4-49f9-b418-f51db32214f6 service nova] Releasing lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:42:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:42:21 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:42:21 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid c3901966-61e2-4be6-bb8f-bbc449c35b78 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:42:21 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updating instance_info_cache with network_info: [{"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:42:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:42:21 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:42:21 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:42:21 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-7b6fe0cc-8159-4c0c-9fcb-af4851aed554 req-3c7f1380-889a-4349-8a80-7ea2c58ac85d service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-changed-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-7b6fe0cc-8159-4c0c-9fcb-af4851aed554 req-3c7f1380-889a-4349-8a80-7ea2c58ac85d service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Refreshing instance network info cache due to event network-changed-67554b09-a82b-4a0b-8ff7-fb5e47c7031a. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7b6fe0cc-8159-4c0c-9fcb-af4851aed554 req-3c7f1380-889a-4349-8a80-7ea2c58ac85d service nova] Acquiring lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7b6fe0cc-8159-4c0c-9fcb-af4851aed554 req-3c7f1380-889a-4349-8a80-7ea2c58ac85d service nova] Acquired lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG nova.network.neutron [req-7b6fe0cc-8159-4c0c-9fcb-af4851aed554 req-3c7f1380-889a-4349-8a80-7ea2c58ac85d service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Refreshing network info cache for port 67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG nova.network.neutron [req-7b6fe0cc-8159-4c0c-9fcb-af4851aed554 req-3c7f1380-889a-4349-8a80-7ea2c58ac85d service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updated VIF entry in instance network info cache for port 67554b09-a82b-4a0b-8ff7-fb5e47c7031a. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG nova.network.neutron [req-7b6fe0cc-8159-4c0c-9fcb-af4851aed554 req-3c7f1380-889a-4349-8a80-7ea2c58ac85d service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updating instance_info_cache with network_info: [{"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7b6fe0cc-8159-4c0c-9fcb-af4851aed554 req-3c7f1380-889a-4349-8a80-7ea2c58ac85d service nova] Releasing lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Stashing vm_state: active {{(pid=73627) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:42:22 user nova-compute[73627]: INFO nova.compute.claims [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Claim successful on node user
Aug 26 16:42:22 user nova-compute[73627]: INFO nova.compute.resource_tracker [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updating resource usage from migration 21f4864c-c48a-49ca-b092-ccfb75c636af
Aug 26 16:42:22 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:42:22 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:42:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.306s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:42:23 user nova-compute[73627]: INFO nova.compute.manager [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Migrating
Aug 26 16:42:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:42:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquired lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:42:23 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:42:23 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updating instance_info_cache with network_info: [{"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:42:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Releasing lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:42:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Starting migrate_disk_and_power_off {{(pid=73627) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 16:42:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-5d4b9647-3e76-4fb5-919e-1a392c251b4a req-8b6543eb-3f60-4e1d-87f2-b69f975d00c1 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-vif-unplugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5d4b9647-3e76-4fb5-919e-1a392c251b4a req-8b6543eb-3f60-4e1d-87f2-b69f975d00c1 service nova] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5d4b9647-3e76-4fb5-919e-1a392c251b4a req-8b6543eb-3f60-4e1d-87f2-b69f975d00c1 service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5d4b9647-3e76-4fb5-919e-1a392c251b4a req-8b6543eb-3f60-4e1d-87f2-b69f975d00c1 service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG nova.compute.manager [req-5d4b9647-3e76-4fb5-919e-1a392c251b4a req-8b6543eb-3f60-4e1d-87f2-b69f975d00c1 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] No waiting events found dispatching network-vif-unplugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:42:24 user nova-compute[73627]: WARNING nova.compute.manager [req-5d4b9647-3e76-4fb5-919e-1a392c251b4a req-8b6543eb-3f60-4e1d-87f2-b69f975d00c1 service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received unexpected event network-vif-unplugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a for instance with vm_state active and task_state resize_migrating.
Aug 26 16:42:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:24 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Instance destroyed successfully.
Aug 26 16:42:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-148211678',display_name='tempest-ServerActionsTestOtherA-server-148211678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-148211678',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPablajuq8xLBFiX0kjjyHTcUxoq8CZCKKmSQoF/n+RncsJGeKPTG3tFOgrEM0xDUb7dmLLfXVGvvH6d7PuXa2K1fYDVua5anrg1Gw7a6no9azLYSkiUBpYQ6yR/vuL6og==',key_name='tempest-keypair-1189535517',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-4n7nlqag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=e9e10c2f-8248-444e-a61a-e2997afde4a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1212226892-network", "vif_mac": "fa:16:3e:5b:80:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1212226892-network", "vif_mac": "fa:16:3e:5b:80:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_vif [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67554b09-a8, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:24 user nova-compute[73627]: INFO os_vif [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8')
Aug 26 16:42:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewHBfLkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:42:24 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40f5406-e6b5-4c27-ac03-25a0c4f12784]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3c1fc1-5b84-463a-9965-001a118d9972]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:42:24 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:42:24 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3ac787b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b97598b-9dfd-4e6e-96d8-66bd31bf80b1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f7900d-f8ef-47fa-8f85-9308a0e0ff05]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e86c966-39ed-46aa-b1ec-03d068cd377d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaf6430-81cb-41e5-b71e-5e56a02b1be0]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO979dd2c2-b992cd01023751da', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_979dd2c2', '/dev/disk/by-id/scsi-26239393263643031') {{(pid=84800) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[305cc49d-ccff-4f23-bd38-9478265e2d1c]: (4, None) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd04ac9c-190f-4551-929a-6cf0d6f67f5b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d9b81e-ebc1-4578-aa8a-3cdbb7f2f8e3]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260]
Aug 26 16:42:24 user nova-compute[73627]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260] successful.
Aug 26 16:42:24 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab3d9e1-02a7-4886-8a5b-d3977c8b7017]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== disconnect_volume: return (319ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:42:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:42:25 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Port 67554b09-a82b-4a0b-8ff7-fb5e47c7031a binding to destination host user is already ACTIVE {{(pid=73627) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-0953f1a0-0264-429d-82d8-4498812c2519 req-73d62bd2-c859-4e2e-b346-ef28ea8e2fef service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0953f1a0-0264-429d-82d8-4498812c2519 req-73d62bd2-c859-4e2e-b346-ef28ea8e2fef service nova] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0953f1a0-0264-429d-82d8-4498812c2519 req-73d62bd2-c859-4e2e-b346-ef28ea8e2fef service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0953f1a0-0264-429d-82d8-4498812c2519 req-73d62bd2-c859-4e2e-b346-ef28ea8e2fef service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-0953f1a0-0264-429d-82d8-4498812c2519 req-73d62bd2-c859-4e2e-b346-ef28ea8e2fef service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] No waiting events found dispatching network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:42:26 user nova-compute[73627]: WARNING nova.compute.manager [req-0953f1a0-0264-429d-82d8-4498812c2519 req-73d62bd2-c859-4e2e-b346-ef28ea8e2fef service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received unexpected event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a for instance with vm_state active and task_state resize_migrated.
Aug 26 16:42:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquired lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG nova.network.neutron [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updating instance_info_cache with network_info: [{"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:42:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Releasing lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG os_brick.utils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabfee22-cd16-4bfa-b640-db7d7deb6350]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8082133-014a-4f33-bd03-7b5751ef8ab2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[055e590a-96a5-4fe3-ac1c-a27ddbe0170a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f450c52b-140a-43c0-82b7-1f3ca3adf9df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:42:27 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:42:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29f92f0-7c2f-4b52-b8a2-05fe27a6776c]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:42:27 user nova-compute[73627]: DEBUG os_brick.utils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:42:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Starting finish_migration {{(pid=73627) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Instance directory exists: not creating {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 16:42:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Creating image(s)
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Ensure instance console log exists: /opt/stack/data/nova/instances/e9e10c2f-8248-444e-a61a-e2997afde4a4/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Start _get_guest_xml network_info=[{"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1212226892-network", "vif_mac": "fa:16:3e:5b:80:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewHBfLkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e9e10c2f-8248-444e-a61a-e2997afde4a4', 'attached_at': '2023-08-26T16:42:39.000000', 'detached_at': '', 'volume_id': '54596b99-bdc8-424b-b5bf-55b05a660508', 'serial': '54596b99-bdc8-424b-b5bf-55b05a660508'}, 'guest_format': None, 'attachment_id': '4f2d8f54-30b9-456a-bc8e-2deb96f66379', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:42:38 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:42:38 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:17Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewHBfLkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:42:38 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:42:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:42:38 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:42:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:42:38 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1b7d63-16c0-42c5-b00b-839adf9fe249]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:42:38 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d7bff-33b6-4c8a-b8c0-cef2ddac3f2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508] added
Aug 26 16:42:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d0d67e-843e-4c98-bb4b-19086cf21a85]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a1695a-6150-4df5-9559-ccf992821dee]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewHBfLkS {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewHBfLkS" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5317c2ad-2071-4706-a4c3-223fb8313e1b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewHBfLkS'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:42:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbaf383-a215-4ad7-9b8b-420da713a8ab]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ddc4c2-ec6f-439d-b3ef-805e9132457f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:42:39 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:42:39 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:42:39 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 16:42:39 user nova-compute[73627]: 
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe98871-1386-48f1-9ebd-efa82b304417]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260]
Aug 26 16:42:39 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260] successful.
Aug 26 16:42:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64ccfde-30a8-455f-8aa8-a6ec30b2c11a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3228ebb4-7008-44ad-9e34-26969e055111]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:42:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:42:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc71e888-7f5e-4b13-a020-c450cb5702bf]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewHBfLkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068144.5153377, e9e10c2f-8248-444e-a61a-e2997afde4a4 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:42:39 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] VM Stopped (Lifecycle Event)
Aug 26 16:42:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-dd897948-27fd-449b-9dc0-2000683a6e9a None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:42:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-dd897948-27fd-449b-9dc0-2000683a6e9a None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:42:39 user nova-compute[73627]: INFO nova.compute.manager [None req-dd897948-27fd-449b-9dc0-2000683a6e9a None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 16:42:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26239393263643031', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239393263643031', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-148211678',display_name='tempest-ServerActionsTestOtherA-server-148211678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-148211678',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPablajuq8xLBFiX0kjjyHTcUxoq8CZCKKmSQoF/n+RncsJGeKPTG3tFOgrEM0xDUb7dmLLfXVGvvH6d7PuXa2K1fYDVua5anrg1Gw7a6no9azLYSkiUBpYQ6yR/vuL6og==',key_name='tempest-keypair-1189535517',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-4n7nlqag',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=e9e10c2f-8248-444e-a61a-e2997afde4a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1212226892-network", "vif_mac": "fa:16:3e:5b:80:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1212226892-network", "vif_mac": "fa:16:3e:5b:80:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:42:40 user nova-compute[73627]:   <uuid>e9e10c2f-8248-444e-a61a-e2997afde4a4</uuid>
Aug 26 16:42:40 user nova-compute[73627]:   <name>instance-00000023</name>
Aug 26 16:42:40 user nova-compute[73627]:   <memory>2097152</memory>
Aug 26 16:42:40 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:42:40 user nova-compute[73627]:   <metadata>
Aug 26 16:42:40 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:42:40 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:42:40 user nova-compute[73627]:       <nova:name>tempest-ServerActionsTestOtherA-server-148211678</nova:name>
Aug 26 16:42:40 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:42:38</nova:creationTime>
Aug 26 16:42:40 user nova-compute[73627]:       <nova:flavor name="m1.small">
Aug 26 16:42:40 user nova-compute[73627]:         <nova:memory>2048</nova:memory>
Aug 26 16:42:40 user nova-compute[73627]:         <nova:disk>20</nova:disk>
Aug 26 16:42:40 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:42:40 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:42:40 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:42:40 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:42:40 user nova-compute[73627]:       <nova:owner>
Aug 26 16:42:40 user nova-compute[73627]:         <nova:user uuid="8945b1b1110e44568e0de86204d65e34">tempest-ServerActionsTestOtherA-1664197223-project-member</nova:user>
Aug 26 16:42:40 user nova-compute[73627]:         <nova:project uuid="3f8aed25a3184cf884a5774515d6d202">tempest-ServerActionsTestOtherA-1664197223</nova:project>
Aug 26 16:42:40 user nova-compute[73627]:       </nova:owner>
Aug 26 16:42:40 user nova-compute[73627]:       <nova:ports>
Aug 26 16:42:40 user nova-compute[73627]:         <nova:port uuid="67554b09-a82b-4a0b-8ff7-fb5e47c7031a">
Aug 26 16:42:40 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 16:42:40 user nova-compute[73627]:         </nova:port>
Aug 26 16:42:40 user nova-compute[73627]:       </nova:ports>
Aug 26 16:42:40 user nova-compute[73627]:     </nova:instance>
Aug 26 16:42:40 user nova-compute[73627]:   </metadata>
Aug 26 16:42:40 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:42:40 user nova-compute[73627]:     <system>
Aug 26 16:42:40 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:42:40 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:42:40 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:42:40 user nova-compute[73627]:       <entry name="serial">e9e10c2f-8248-444e-a61a-e2997afde4a4</entry>
Aug 26 16:42:40 user nova-compute[73627]:       <entry name="uuid">e9e10c2f-8248-444e-a61a-e2997afde4a4</entry>
Aug 26 16:42:40 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:42:40 user nova-compute[73627]:     </system>
Aug 26 16:42:40 user nova-compute[73627]:   </sysinfo>
Aug 26 16:42:40 user nova-compute[73627]:   <os>
Aug 26 16:42:40 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:42:40 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:42:40 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:42:40 user nova-compute[73627]:   </os>
Aug 26 16:42:40 user nova-compute[73627]:   <features>
Aug 26 16:42:40 user nova-compute[73627]:     <acpi/>
Aug 26 16:42:40 user nova-compute[73627]:     <apic/>
Aug 26 16:42:40 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:42:40 user nova-compute[73627]:   </features>
Aug 26 16:42:40 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:42:40 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:42:40 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:42:40 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:42:40 user nova-compute[73627]:   </clock>
Aug 26 16:42:40 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:42:40 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:42:40 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:42:40 user nova-compute[73627]:   </cpu>
Aug 26 16:42:40 user nova-compute[73627]:   <devices>
Aug 26 16:42:40 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:42:40 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:42:40 user nova-compute[73627]:       <source dev="/dev/sdb"/>
Aug 26 16:42:40 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:42:40 user nova-compute[73627]:       <serial>54596b99-bdc8-424b-b5bf-55b05a660508</serial>
Aug 26 16:42:40 user nova-compute[73627]:     </disk>
Aug 26 16:42:40 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:42:40 user nova-compute[73627]:       <mac address="fa:16:3e:5b:80:5d"/>
Aug 26 16:42:40 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:42:40 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:42:40 user nova-compute[73627]:       <target dev="tap67554b09-a8"/>
Aug 26 16:42:40 user nova-compute[73627]:     </interface>
Aug 26 16:42:40 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:42:40 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/e9e10c2f-8248-444e-a61a-e2997afde4a4/console.log" append="off"/>
Aug 26 16:42:40 user nova-compute[73627]:     </serial>
Aug 26 16:42:40 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:42:40 user nova-compute[73627]:     <video>
Aug 26 16:42:40 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:42:40 user nova-compute[73627]:     </video>
Aug 26 16:42:40 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:42:40 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:42:40 user nova-compute[73627]:     </rng>
Aug 26 16:42:40 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:42:40 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:42:40 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:42:40 user nova-compute[73627]:     </memballoon>
Aug 26 16:42:40 user nova-compute[73627]:   </devices>
Aug 26 16:42:40 user nova-compute[73627]: </domain>
Aug 26 16:42:40 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-148211678',display_name='tempest-ServerActionsTestOtherA-server-148211678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-148211678',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPablajuq8xLBFiX0kjjyHTcUxoq8CZCKKmSQoF/n+RncsJGeKPTG3tFOgrEM0xDUb7dmLLfXVGvvH6d7PuXa2K1fYDVua5anrg1Gw7a6no9azLYSkiUBpYQ6yR/vuL6og==',key_name='tempest-keypair-1189535517',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-4n7nlqag',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=e9e10c2f-8248-444e-a61a-e2997afde4a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1212226892-network", "vif_mac": "fa:16:3e:5b:80:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1212226892-network", "vif_mac": "fa:16:3e:5b:80:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG os_vif [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67554b09-a8, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67554b09-a8, col_values=(('external_ids', {'iface-id': '67554b09-a82b-4a0b-8ff7-fb5e47c7031a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:80:5d', 'vm-uuid': 'e9e10c2f-8248-444e-a61a-e2997afde4a4'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:40 user nova-compute[73627]: INFO os_vif [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8')
Aug 26 16:42:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] No VIF found with MAC fa:16:3e:5b:80:5d, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:42:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-cd724a82-5c50-44d6-bcfe-38c337548972 req-f2c28af9-9002-4ee2-ad91-7230ed99cffc service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:42:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cd724a82-5c50-44d6-bcfe-38c337548972 req-f2c28af9-9002-4ee2-ad91-7230ed99cffc service nova] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:42:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cd724a82-5c50-44d6-bcfe-38c337548972 req-f2c28af9-9002-4ee2-ad91-7230ed99cffc service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:42:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cd724a82-5c50-44d6-bcfe-38c337548972 req-f2c28af9-9002-4ee2-ad91-7230ed99cffc service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:42:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-cd724a82-5c50-44d6-bcfe-38c337548972 req-f2c28af9-9002-4ee2-ad91-7230ed99cffc service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] No waiting events found dispatching network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:42:41 user nova-compute[73627]: WARNING nova.compute.manager [req-cd724a82-5c50-44d6-bcfe-38c337548972 req-f2c28af9-9002-4ee2-ad91-7230ed99cffc service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received unexpected event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a for instance with vm_state active and task_state resize_finish.
Aug 26 16:42:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:43 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068163.806441, e9e10c2f-8248-444e-a61a-e2997afde4a4 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:42:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] VM Resumed (Lifecycle Event)
Aug 26 16:42:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:42:43 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Instance running successfully.
Aug 26 16:42:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Failed to set time: agent not configured {{(pid=73627) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 16:42:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c273daa0-df81-4633-8a06-65e4031df813 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] finish_migration finished successfully. {{(pid=73627) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 16:42:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:42:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:42:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 16:42:43 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068163.8110251, e9e10c2f-8248-444e-a61a-e2997afde4a4 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:42:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] VM Started (Lifecycle Event)
Aug 26 16:42:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:42:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:42:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-ae390711-3390-4a60-afc8-434ce50fb78c req-eb392cfc-f263-4c4c-8bb0-bfa1acd6664c service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:42:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ae390711-3390-4a60-afc8-434ce50fb78c req-eb392cfc-f263-4c4c-8bb0-bfa1acd6664c service nova] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:42:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ae390711-3390-4a60-afc8-434ce50fb78c req-eb392cfc-f263-4c4c-8bb0-bfa1acd6664c service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:42:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-ae390711-3390-4a60-afc8-434ce50fb78c req-eb392cfc-f263-4c4c-8bb0-bfa1acd6664c service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:42:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-ae390711-3390-4a60-afc8-434ce50fb78c req-eb392cfc-f263-4c4c-8bb0-bfa1acd6664c service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] No waiting events found dispatching network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:42:43 user nova-compute[73627]: WARNING nova.compute.manager [req-ae390711-3390-4a60-afc8-434ce50fb78c req-eb392cfc-f263-4c4c-8bb0-bfa1acd6664c service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received unexpected event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a for instance with vm_state active and task_state resize_finish.
Aug 26 16:42:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 16:42:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:42:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:42:54 user nova-compute[73627]: DEBUG nova.objects.instance [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'flavor' on Instance uuid 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:42:54 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:42:55 user nova-compute[73627]: INFO nova.compute.manager [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Attaching volume ba92766d-73cb-4f42-80c0-4320efec34d8 to /dev/vdb
Aug 26 16:42:55 user nova-compute[73627]: DEBUG os_brick.utils [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1474d0-afcb-4133-a67c-cd774c33faf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[481dd140-7a03-48ca-82c6-4e6e5350a58c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b10029-9480-489b-af83-4f495eff34a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5cf782-dea0-48a0-b93c-3965ca32278d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:42:55 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:42:55 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d06eecf-68ff-459e-947c-3b4b72fc395d]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG os_brick.utils [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updating existing volume attachment record: 8828cbaa-f092-49d3-a638-f693b4e137ae {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:42:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spGFqTgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:43:07 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:43:07 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:43:07 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c161450f-f027-4645-a48c-cd6f5a2157c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:43:07 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac565528-51ea-414d-aa5e-1c42d451cef0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8] added
Aug 26 16:43:07 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d21ecf-cfc7-4c79-8da7-b73647f64b41]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6811d356-b827-4514-84b4-37427e579935]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spGFqTgi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spGFqTgi" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3226b8-e7bf-46ea-9cb7-95c1730fb771]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'spGFqTgi'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4f668e-8eb8-4980-87ba-5b42e060a827]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8533a1-a3aa-4647-a20c-b7f9ce3259ba]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:43:07 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:43:07 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd702bb-5060-411f-b375-df43fe8d4188]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8, portal: 172.16.0.220,3260]
Aug 26 16:43:07 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8, portal: 172.16.0.220,3260] successful.
Aug 26 16:43:07 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd10f2ec-1229-47f9-ba7e-3139d574aef7]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3086e0ff-0366-4a16-81a9-3b96a63751fa]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:43:07 user nova-compute[73627]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)
Aug 26 16:43:07 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:43:07 user nova-compute[73627]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)
Aug 26 16:43:07 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31920df-c517-4141-ab16-e9a4b45e8336]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:43:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spGFqTgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:43:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "06a4f983-1867-4156-b2c2-f34bde5e3077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:08 user nova-compute[73627]: DEBUG nova.compute.manager [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:43:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:43:08 user nova-compute[73627]: INFO nova.compute.claims [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Claim successful on node user
Aug 26 16:43:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:43:08 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26331663530663437', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:43:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331663530663437', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:43:08 user nova-compute[73627]: DEBUG nova.objects.instance [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'flavor' on Instance uuid 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:43:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:43:08 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:43:08 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:43:08 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:43:08 user nova-compute[73627]:   <serial>ba92766d-73cb-4f42-80c0-4320efec34d8</serial>
Aug 26 16:43:08 user nova-compute[73627]: </disk>
Aug 26 16:43:08 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:43:09 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:43:09 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:43:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:43:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:43:09 user nova-compute[73627]: DEBUG nova.network.neutron [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:43:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:43:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:43:09 user nova-compute[73627]: INFO nova.virt.block_device [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Booting with volume snapshot 39dd91a3-50bc-49e5-a514-928b17b1f891 at /dev/vda
Aug 26 16:43:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:43:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:43:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] No VIF found with MAC fa:16:3e:77:d4:68, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:43:09 user nova-compute[73627]: DEBUG nova.policy [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c2828f3769d420b9d9caef2e6bc902f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4241157d52c848d49bed0589c2ec725e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:43:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ae9a63e5-7c78-47dc-902a-b2dd04c37312 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.343s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Successfully created port: 60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:43:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Successfully updated port: 60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "refresh_cache-06a4f983-1867-4156-b2c2-f34bde5e3077" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquired lock "refresh_cache-06a4f983-1867-4156-b2c2-f34bde5e3077" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-6c4d3aeb-8fdb-4c7b-8317-775ffe065ba0 req-e095f374-e8fa-42b2-9e55-2af46230630a service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Received event network-changed-60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-6c4d3aeb-8fdb-4c7b-8317-775ffe065ba0 req-e095f374-e8fa-42b2-9e55-2af46230630a service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Refreshing instance network info cache due to event network-changed-60d9ba8a-f563-4a51-a0cd-8f99b741e131. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c4d3aeb-8fdb-4c7b-8317-775ffe065ba0 req-e095f374-e8fa-42b2-9e55-2af46230630a service nova] Acquiring lock "refresh_cache-06a4f983-1867-4156-b2c2-f34bde5e3077" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Updating instance_info_cache with network_info: [{"id": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "address": "fa:16:3e:03:b6:24", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60d9ba8a-f5", "ovs_interfaceid": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Releasing lock "refresh_cache-06a4f983-1867-4156-b2c2-f34bde5e3077" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Instance network_info: |[{"id": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "address": "fa:16:3e:03:b6:24", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60d9ba8a-f5", "ovs_interfaceid": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c4d3aeb-8fdb-4c7b-8317-775ffe065ba0 req-e095f374-e8fa-42b2-9e55-2af46230630a service nova] Acquired lock "refresh_cache-06a4f983-1867-4156-b2c2-f34bde5e3077" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:43:11 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c4d3aeb-8fdb-4c7b-8317-775ffe065ba0 req-e095f374-e8fa-42b2-9e55-2af46230630a service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Refreshing network info cache for port 60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:43:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c4d3aeb-8fdb-4c7b-8317-775ffe065ba0 req-e095f374-e8fa-42b2-9e55-2af46230630a service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Updated VIF entry in instance network info cache for port 60d9ba8a-f563-4a51-a0cd-8f99b741e131. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:43:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-6c4d3aeb-8fdb-4c7b-8317-775ffe065ba0 req-e095f374-e8fa-42b2-9e55-2af46230630a service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Updating instance_info_cache with network_info: [{"id": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "address": "fa:16:3e:03:b6:24", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60d9ba8a-f5", "ovs_interfaceid": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:43:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6c4d3aeb-8fdb-4c7b-8317-775ffe065ba0 req-e095f374-e8fa-42b2-9e55-2af46230630a service nova] Releasing lock "refresh_cache-06a4f983-1867-4156-b2c2-f34bde5e3077" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:43:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:43:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-7e17abd9-79ff-40e1-b3c9-7e5cd108f999 req-eeed37ac-bf7b-4bba-b5e0-bdf3e48f0fe7 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-changed-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-7e17abd9-79ff-40e1-b3c9-7e5cd108f999 req-eeed37ac-bf7b-4bba-b5e0-bdf3e48f0fe7 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Refreshing instance network info cache due to event network-changed-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:43:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7e17abd9-79ff-40e1-b3c9-7e5cd108f999 req-eeed37ac-bf7b-4bba-b5e0-bdf3e48f0fe7 service nova] Acquiring lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:43:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7e17abd9-79ff-40e1-b3c9-7e5cd108f999 req-eeed37ac-bf7b-4bba-b5e0-bdf3e48f0fe7 service nova] Acquired lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:43:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-7e17abd9-79ff-40e1-b3c9-7e5cd108f999 req-eeed37ac-bf7b-4bba-b5e0-bdf3e48f0fe7 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Refreshing network info cache for port d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:43:13 user nova-compute[73627]: DEBUG nova.network.neutron [req-7e17abd9-79ff-40e1-b3c9-7e5cd108f999 req-eeed37ac-bf7b-4bba-b5e0-bdf3e48f0fe7 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updated VIF entry in instance network info cache for port d8ac6436-eeb9-479d-acc8-b244e8f7ceb4. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:43:13 user nova-compute[73627]: DEBUG nova.network.neutron [req-7e17abd9-79ff-40e1-b3c9-7e5cd108f999 req-eeed37ac-bf7b-4bba-b5e0-bdf3e48f0fe7 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updating instance_info_cache with network_info: [{"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:43:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7e17abd9-79ff-40e1-b3c9-7e5cd108f999 req-eeed37ac-bf7b-4bba-b5e0-bdf3e48f0fe7 service nova] Releasing lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:43:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "61758740-6a39-4e9b-9e52-5680505a3d94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "61758740-6a39-4e9b-9e52-5680505a3d94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:13 user nova-compute[73627]: INFO nova.compute.manager [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Terminating instance
Aug 26 16:43:13 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:43:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:43:14 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Instance destroyed successfully.
Aug 26 16:43:14 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lazy-loading 'resources' on Instance uuid 61758740-6a39-4e9b-9e52-5680505a3d94 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1421601558',display_name='tempest-VolumesActionsTest-instance-1421601558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1421601558',id=37,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06fa96cd11e64d2083b9ce6f331ac19c',ramdisk_id='',reservation_id='r-7i8921oe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1696244677',owner_user_name='tempest-VolumesActionsTest-1696244677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:41:30Z,user_data=None,user_id='65e9557ef8a44c1dbd6f3889f3dd3586',uuid=61758740-6a39-4e9b-9e52-5680505a3d94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "address": "fa:16:3e:90:c6:64", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9c284b-67", "ovs_interfaceid": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converting VIF {"id": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "address": "fa:16:3e:90:c6:64", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9c284b-67", "ovs_interfaceid": "5f9c284b-67d6-437f-a94a-e9f1d7dc7539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9c284b-67d6-437f-a94a-e9f1d7dc7539,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9c284b-67') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG os_vif [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9c284b-67d6-437f-a94a-e9f1d7dc7539,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9c284b-67') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f9c284b-67, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:43:14 user nova-compute[73627]: INFO os_vif [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c6:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9c284b-67d6-437f-a94a-e9f1d7dc7539,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9c284b-67')
Aug 26 16:43:14 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Deleting instance files /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94_del
Aug 26 16:43:14 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Deletion of /opt/stack/data/nova/instances/61758740-6a39-4e9b-9e52-5680505a3d94_del complete
Aug 26 16:43:14 user nova-compute[73627]: INFO nova.compute.manager [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 16:43:14 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Received event network-vif-unplugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] Acquiring lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] Lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] Lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] No waiting events found dispatching network-vif-unplugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Received event network-vif-unplugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Received event network-vif-plugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] Acquiring lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] Lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] Lock "61758740-6a39-4e9b-9e52-5680505a3d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] No waiting events found dispatching network-vif-plugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:43:14 user nova-compute[73627]: WARNING nova.compute.manager [req-39977054-f820-4ed2-9042-d705e6550366 req-5fbb0b76-b9d2-4c97-8bd1-03cd45874cac service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Received unexpected event network-vif-plugged-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 for instance with vm_state active and task_state deleting.
Aug 26 16:43:15 user nova-compute[73627]: DEBUG os_brick.utils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef8e0ee-f867-4e72-8ae1-de13ed300e94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d752c2-368a-4a4c-85b4-9e1a602b9960]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[01190637-65ff-42b5-b78e-7c3b82b8d886]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63f8ff0-fc11-4e04-b39e-3153be7256ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:43:15 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[113603f3-2385-449d-befb-96d04ec32bb6]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG os_brick.utils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Updating existing volume attachment record: b762b82c-92ae-460b-a704-8c037276e7d0 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG nova.compute.manager [req-16b714c0-a4c6-451f-8a23-83d291fb1517 req-cfbca92d-3071-4cf0-a3b9-22dbd0133c56 service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Received event network-vif-deleted-5f9c284b-67d6-437f-a94a-e9f1d7dc7539 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:15 user nova-compute[73627]: INFO nova.compute.manager [req-16b714c0-a4c6-451f-8a23-83d291fb1517 req-cfbca92d-3071-4cf0-a3b9-22dbd0133c56 service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Neutron deleted interface 5f9c284b-67d6-437f-a94a-e9f1d7dc7539; detaching it from the instance and deleting it from the info cache
Aug 26 16:43:15 user nova-compute[73627]: DEBUG nova.network.neutron [req-16b714c0-a4c6-451f-8a23-83d291fb1517 req-cfbca92d-3071-4cf0-a3b9-22dbd0133c56 service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:43:15 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Took 0.58 seconds to deallocate network for instance.
Aug 26 16:43:15 user nova-compute[73627]: DEBUG nova.compute.manager [req-16b714c0-a4c6-451f-8a23-83d291fb1517 req-cfbca92d-3071-4cf0-a3b9-22dbd0133c56 service nova] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Detach interface failed, port_id=5f9c284b-67d6-437f-a94a-e9f1d7dc7539, reason: Instance 61758740-6a39-4e9b-9e52-5680505a3d94 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:15 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Deleted allocations for instance 61758740-6a39-4e9b-9e52-5680505a3d94
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c847c807-3ccd-486e-92d8-04632e5d0d76 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "61758740-6a39-4e9b-9e52-5680505a3d94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.951s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:15 user nova-compute[73627]: INFO nova.compute.manager [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Rebooting instance
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquired lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG nova.network.neutron [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:43:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:16 user nova-compute[73627]: DEBUG nova.network.neutron [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updating instance_info_cache with network_info: [{"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:43:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Releasing lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:43:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:43:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-67ea062d-7174-4ab0-a898-45ad69059af7 req-c42b67f3-2003-49fe-bf63-ad4b66912d34 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-changed-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-67ea062d-7174-4ab0-a898-45ad69059af7 req-c42b67f3-2003-49fe-bf63-ad4b66912d34 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Refreshing instance network info cache due to event network-changed-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:43:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-67ea062d-7174-4ab0-a898-45ad69059af7 req-c42b67f3-2003-49fe-bf63-ad4b66912d34 service nova] Acquiring lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:43:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-67ea062d-7174-4ab0-a898-45ad69059af7 req-c42b67f3-2003-49fe-bf63-ad4b66912d34 service nova] Acquired lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:43:16 user nova-compute[73627]: DEBUG nova.network.neutron [req-67ea062d-7174-4ab0-a898-45ad69059af7 req-c42b67f3-2003-49fe-bf63-ad4b66912d34 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Refreshing network info cache for port d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:43:17 user nova-compute[73627]: DEBUG nova.network.neutron [req-67ea062d-7174-4ab0-a898-45ad69059af7 req-c42b67f3-2003-49fe-bf63-ad4b66912d34 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updated VIF entry in instance network info cache for port d8ac6436-eeb9-479d-acc8-b244e8f7ceb4. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:43:17 user nova-compute[73627]: DEBUG nova.network.neutron [req-67ea062d-7174-4ab0-a898-45ad69059af7 req-c42b67f3-2003-49fe-bf63-ad4b66912d34 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updating instance_info_cache with network_info: [{"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:43:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-67ea062d-7174-4ab0-a898-45ad69059af7 req-c42b67f3-2003-49fe-bf63-ad4b66912d34 service nova] Releasing lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:43:17 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:43:18 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:43:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:18 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:43:18 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:43:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-5a1d7635-94bb-44f9-a8c5-e8783c8ebbc1 req-8d7696c7-996b-4b08-8917-3c36b9621419 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-vif-unplugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5a1d7635-94bb-44f9-a8c5-e8783c8ebbc1 req-8d7696c7-996b-4b08-8917-3c36b9621419 service nova] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5a1d7635-94bb-44f9-a8c5-e8783c8ebbc1 req-8d7696c7-996b-4b08-8917-3c36b9621419 service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5a1d7635-94bb-44f9-a8c5-e8783c8ebbc1 req-8d7696c7-996b-4b08-8917-3c36b9621419 service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-5a1d7635-94bb-44f9-a8c5-e8783c8ebbc1 req-8d7696c7-996b-4b08-8917-3c36b9621419 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] No waiting events found dispatching network-vif-unplugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:43:19 user nova-compute[73627]: WARNING nova.compute.manager [req-5a1d7635-94bb-44f9-a8c5-e8783c8ebbc1 req-8d7696c7-996b-4b08-8917-3c36b9621419 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received unexpected event network-vif-unplugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 for instance with vm_state active and task_state reboot_started.
Aug 26 16:43:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:20 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:43:20 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8252MB free_disk=25.33858871459961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Instance shutdown successfully.
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Applying migration context for instance e9e10c2f-8248-444e-a61a-e2997afde4a4 as it has an incoming, in-progress migration 21f4864c-c48a-49ca-b092-ccfb75c636af. Migration status is finished {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 16:43:20 user nova-compute[73627]: INFO nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updating resource usage from migration 21f4864c-c48a-49ca-b092-ccfb75c636af
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Migration 21f4864c-c48a-49ca-b092-ccfb75c636af is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance e9e10c2f-8248-444e-a61a-e2997afde4a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 06a4f983-1867-4156-b2c2-f34bde5e3077 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-683c707e-552a-4af3-8c0e-42fd40290356 req-23d224c6-3e8c-4ec3-aa74-3f5a92badc5c service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-683c707e-552a-4af3-8c0e-42fd40290356 req-23d224c6-3e8c-4ec3-aa74-3f5a92badc5c service nova] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-683c707e-552a-4af3-8c0e-42fd40290356 req-23d224c6-3e8c-4ec3-aa74-3f5a92badc5c service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-683c707e-552a-4af3-8c0e-42fd40290356 req-23d224c6-3e8c-4ec3-aa74-3f5a92badc5c service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-683c707e-552a-4af3-8c0e-42fd40290356 req-23d224c6-3e8c-4ec3-aa74-3f5a92badc5c service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] No waiting events found dispatching network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:43:21 user nova-compute[73627]: WARNING nova.compute.manager [req-683c707e-552a-4af3-8c0e-42fd40290356 req-23d224c6-3e8c-4ec3-aa74-3f5a92badc5c service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received unexpected event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 for instance with vm_state active and task_state reboot_started.
Aug 26 16:43:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:43:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:43:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:43:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:43:22 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:43:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updating instance_info_cache with network_info: [{"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] No waiting events found dispatching network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:43:23 user nova-compute[73627]: WARNING nova.compute.manager [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received unexpected event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 for instance with vm_state active and task_state reboot_started.
Aug 26 16:43:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] No waiting events found dispatching network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:43:23 user nova-compute[73627]: WARNING nova.compute.manager [req-b5867287-47a3-4e16-8ea5-933fd7319bb2 req-f351dfe6-104b-4c84-a55b-9281bf064b4c service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received unexpected event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 for instance with vm_state active and task_state reboot_started.
Aug 26 16:43:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Removed pending event for 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 due to event {{(pid=73627) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 16:43:24 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068204.2468495, 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:43:24 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] VM Resumed (Lifecycle Event)
Aug 26 16:43:24 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Instance running successfully.
Aug 26 16:43:24 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Instance soft rebooted successfully.
Aug 26 16:43:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:43:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:43:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:43:24 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 26 16:43:24 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068204.2516382, 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:43:24 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] VM Started (Lifecycle Event)
Aug 26 16:43:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:43:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-10495c66-52e6-4a32-9b65-ea33f7c82f7e tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.452s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:43:24 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:43:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:43:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:43:29 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068194.6873915, 61758740-6a39-4e9b-9e52-5680505a3d94 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:43:29 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] VM Stopped (Lifecycle Event)
Aug 26 16:43:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c910c851-a51d-4876-9cf0-4ea75c9b3b78 None None] [instance: 61758740-6a39-4e9b-9e52-5680505a3d94] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:43:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:43:34 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Creating image(s)
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Ensure instance console log exists: /opt/stack/data/nova/instances/06a4f983-1867-4156-b2c2-f34bde5e3077/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Start _get_guest_xml network_info=[{"id": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "address": "fa:16:3e:03:b6:24", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60d9ba8a-f5", "ovs_interfaceid": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NieCvXJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06a4f983-1867-4156-b2c2-f34bde5e3077', 'attached_at': '', 'detached_at': '', 'volume_id': '7c81db73-27d9-401b-90a2-28f0271b7a3d', 'serial': '7c81db73-27d9-401b-90a2-28f0271b7a3d'}, 'guest_format': None, 'attachment_id': 'b762b82c-92ae-460b-a704-8c037276e7d0', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:43:34 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:43:34 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NieCvXJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:43:34 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:43:34 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:43:34 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ad828-3af2-4818-86aa-a89d40b1775f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:43:34 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a29a3a-4a3e-4ab3-8f6c-83908a3b33e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d] added
Aug 26 16:43:34 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a546358-e315-434b-86ac-2db62b5fad8b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedf7041-d16f-439e-993a-a826f1232fb6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NieCvXJd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NieCvXJd" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f8b793-e739-4c67-b587-91bb556d44a0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NieCvXJd'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aabe88-090b-4cc2-8740-0adf998f95f0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fc6ce5-20e9-4ea6-a837-8c708e80d99d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:43:34 user nova-compute[73627]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)
Aug 26 16:43:34 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:43:34 user nova-compute[73627]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)
Aug 26 16:43:34 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16bffbc-76f3-45b5-ae79-bed744db319d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d, portal: 172.16.0.220,3260]
Aug 26 16:43:34 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d, portal: 172.16.0.220,3260] successful.
Aug 26 16:43:34 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea99502-6b2c-4c28-9af0-a6c9d1d01389]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7c4910-a175-4824-b3c8-f508eb7fcfcb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:43:34 user nova-compute[73627]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)
Aug 26 16:43:34 user nova-compute[73627]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d (non-flash)
Aug 26 16:43:34 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:43:34 user nova-compute[73627]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)
Aug 26 16:43:34 user nova-compute[73627]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d (non-flash)
Aug 26 16:43:34 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2f4b8e-2265-4f03-9eba-7f2b000eb7c4]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:43:34 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NieCvXJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23862643636353462', 'path': '/dev/sdd'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862643636353462', 'path': '/dev/sdd'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2111848364',display_name='tempest-TestVolumeBootPattern-server-2111848364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2111848364',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-dtv6aybn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:43:09Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=06a4f983-1867-4156-b2c2-f34bde5e3077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "address": "fa:16:3e:03:b6:24", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60d9ba8a-f5", "ovs_interfaceid": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "address": "fa:16:3e:03:b6:24", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60d9ba8a-f5", "ovs_interfaceid": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b6:24,bridge_name='br-int',has_traffic_filtering=True,id=60d9ba8a-f563-4a51-a0cd-8f99b741e131,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60d9ba8a-f5') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG nova.objects.instance [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'pci_devices' on Instance uuid 06a4f983-1867-4156-b2c2-f34bde5e3077 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:43:35 user nova-compute[73627]:   <uuid>06a4f983-1867-4156-b2c2-f34bde5e3077</uuid>
Aug 26 16:43:35 user nova-compute[73627]:   <name>instance-00000026</name>
Aug 26 16:43:35 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:43:35 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:43:35 user nova-compute[73627]:   <metadata>
Aug 26 16:43:35 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:43:35 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:43:35 user nova-compute[73627]:       <nova:name>tempest-TestVolumeBootPattern-server-2111848364</nova:name>
Aug 26 16:43:35 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:43:34</nova:creationTime>
Aug 26 16:43:35 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:43:35 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:43:35 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:43:35 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:43:35 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:43:35 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:43:35 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:43:35 user nova-compute[73627]:       <nova:owner>
Aug 26 16:43:35 user nova-compute[73627]:         <nova:user uuid="1c2828f3769d420b9d9caef2e6bc902f">tempest-TestVolumeBootPattern-1705344746-project-member</nova:user>
Aug 26 16:43:35 user nova-compute[73627]:         <nova:project uuid="4241157d52c848d49bed0589c2ec725e">tempest-TestVolumeBootPattern-1705344746</nova:project>
Aug 26 16:43:35 user nova-compute[73627]:       </nova:owner>
Aug 26 16:43:35 user nova-compute[73627]:       <nova:ports>
Aug 26 16:43:35 user nova-compute[73627]:         <nova:port uuid="60d9ba8a-f563-4a51-a0cd-8f99b741e131">
Aug 26 16:43:35 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 16:43:35 user nova-compute[73627]:         </nova:port>
Aug 26 16:43:35 user nova-compute[73627]:       </nova:ports>
Aug 26 16:43:35 user nova-compute[73627]:     </nova:instance>
Aug 26 16:43:35 user nova-compute[73627]:   </metadata>
Aug 26 16:43:35 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:43:35 user nova-compute[73627]:     <system>
Aug 26 16:43:35 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:43:35 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:43:35 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:43:35 user nova-compute[73627]:       <entry name="serial">06a4f983-1867-4156-b2c2-f34bde5e3077</entry>
Aug 26 16:43:35 user nova-compute[73627]:       <entry name="uuid">06a4f983-1867-4156-b2c2-f34bde5e3077</entry>
Aug 26 16:43:35 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:43:35 user nova-compute[73627]:     </system>
Aug 26 16:43:35 user nova-compute[73627]:   </sysinfo>
Aug 26 16:43:35 user nova-compute[73627]:   <os>
Aug 26 16:43:35 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:43:35 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:43:35 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:43:35 user nova-compute[73627]:   </os>
Aug 26 16:43:35 user nova-compute[73627]:   <features>
Aug 26 16:43:35 user nova-compute[73627]:     <acpi/>
Aug 26 16:43:35 user nova-compute[73627]:     <apic/>
Aug 26 16:43:35 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:43:35 user nova-compute[73627]:   </features>
Aug 26 16:43:35 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:43:35 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:43:35 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:43:35 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:43:35 user nova-compute[73627]:   </clock>
Aug 26 16:43:35 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:43:35 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:43:35 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:43:35 user nova-compute[73627]:   </cpu>
Aug 26 16:43:35 user nova-compute[73627]:   <devices>
Aug 26 16:43:35 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:43:35 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:43:35 user nova-compute[73627]:       <source dev="/dev/sdd"/>
Aug 26 16:43:35 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:43:35 user nova-compute[73627]:       <serial>7c81db73-27d9-401b-90a2-28f0271b7a3d</serial>
Aug 26 16:43:35 user nova-compute[73627]:     </disk>
Aug 26 16:43:35 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:43:35 user nova-compute[73627]:       <mac address="fa:16:3e:03:b6:24"/>
Aug 26 16:43:35 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:43:35 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:43:35 user nova-compute[73627]:       <target dev="tap60d9ba8a-f5"/>
Aug 26 16:43:35 user nova-compute[73627]:     </interface>
Aug 26 16:43:35 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:43:35 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/06a4f983-1867-4156-b2c2-f34bde5e3077/console.log" append="off"/>
Aug 26 16:43:35 user nova-compute[73627]:     </serial>
Aug 26 16:43:35 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:43:35 user nova-compute[73627]:     <video>
Aug 26 16:43:35 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:43:35 user nova-compute[73627]:     </video>
Aug 26 16:43:35 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:43:35 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:43:35 user nova-compute[73627]:     </rng>
Aug 26 16:43:35 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:43:35 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:43:35 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:43:35 user nova-compute[73627]:     </memballoon>
Aug 26 16:43:35 user nova-compute[73627]:   </devices>
Aug 26 16:43:35 user nova-compute[73627]: </domain>
Aug 26 16:43:35 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2111848364',display_name='tempest-TestVolumeBootPattern-server-2111848364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2111848364',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-dtv6aybn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:43:09Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=06a4f983-1867-4156-b2c2-f34bde5e3077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "address": "fa:16:3e:03:b6:24", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60d9ba8a-f5", "ovs_interfaceid": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "address": "fa:16:3e:03:b6:24", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60d9ba8a-f5", "ovs_interfaceid": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b6:24,bridge_name='br-int',has_traffic_filtering=True,id=60d9ba8a-f563-4a51-a0cd-8f99b741e131,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60d9ba8a-f5') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG os_vif [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b6:24,bridge_name='br-int',has_traffic_filtering=True,id=60d9ba8a-f563-4a51-a0cd-8f99b741e131,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60d9ba8a-f5') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60d9ba8a-f5, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60d9ba8a-f5, col_values=(('external_ids', {'iface-id': '60d9ba8a-f563-4a51-a0cd-8f99b741e131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:b6:24', 'vm-uuid': '06a4f983-1867-4156-b2c2-f34bde5e3077'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:35 user nova-compute[73627]: INFO os_vif [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b6:24,bridge_name='br-int',has_traffic_filtering=True,id=60d9ba8a-f563-4a51-a0cd-8f99b741e131,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60d9ba8a-f5')
Aug 26 16:43:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:43:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No VIF found with MAC fa:16:3e:03:b6:24, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:43:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:37 user nova-compute[73627]: DEBUG nova.compute.manager [req-7ae8085f-29b5-4bc5-9426-bae09f69778d req-66cfe134-b604-42bb-a884-40b6065480a1 service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Received event network-vif-plugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ae8085f-29b5-4bc5-9426-bae09f69778d req-66cfe134-b604-42bb-a884-40b6065480a1 service nova] Acquiring lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ae8085f-29b5-4bc5-9426-bae09f69778d req-66cfe134-b604-42bb-a884-40b6065480a1 service nova] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ae8085f-29b5-4bc5-9426-bae09f69778d req-66cfe134-b604-42bb-a884-40b6065480a1 service nova] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:37 user nova-compute[73627]: DEBUG nova.compute.manager [req-7ae8085f-29b5-4bc5-9426-bae09f69778d req-66cfe134-b604-42bb-a884-40b6065480a1 service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] No waiting events found dispatching network-vif-plugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:43:37 user nova-compute[73627]: WARNING nova.compute.manager [req-7ae8085f-29b5-4bc5-9426-bae09f69778d req-66cfe134-b604-42bb-a884-40b6065480a1 service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Received unexpected event network-vif-plugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 for instance with vm_state building and task_state spawning.
Aug 26 16:43:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068219.3492393, 06a4f983-1867-4156-b2c2-f34bde5e3077 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:43:39 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] VM Resumed (Lifecycle Event)
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-7794ccbc-9af9-40d8-96e5-b717e079fe6f req-5d8d7c54-12ff-4d52-ba44-240f15429347 service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Received event network-vif-plugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7794ccbc-9af9-40d8-96e5-b717e079fe6f req-5d8d7c54-12ff-4d52-ba44-240f15429347 service nova] Acquiring lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7794ccbc-9af9-40d8-96e5-b717e079fe6f req-5d8d7c54-12ff-4d52-ba44-240f15429347 service nova] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7794ccbc-9af9-40d8-96e5-b717e079fe6f req-5d8d7c54-12ff-4d52-ba44-240f15429347 service nova] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.compute.manager [req-7794ccbc-9af9-40d8-96e5-b717e079fe6f req-5d8d7c54-12ff-4d52-ba44-240f15429347 service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] No waiting events found dispatching network-vif-plugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:43:39 user nova-compute[73627]: WARNING nova.compute.manager [req-7794ccbc-9af9-40d8-96e5-b717e079fe6f req-5d8d7c54-12ff-4d52-ba44-240f15429347 service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Received unexpected event network-vif-plugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 for instance with vm_state building and task_state spawning.
Aug 26 16:43:39 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Instance spawned successfully.
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:43:39 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068219.3501186, 06a4f983-1867-4156-b2c2-f34bde5e3077 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:43:39 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] VM Started (Lifecycle Event)
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:43:39 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:43:39 user nova-compute[73627]: INFO nova.compute.manager [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 26 16:43:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:43:39 user nova-compute[73627]: INFO nova.compute.manager [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Took 31.03 seconds to build instance.
Aug 26 16:43:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-953b61b7-141c-4df4-a2d9-64b2c5ee14ed tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.140s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:43:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:43:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "230d355a-2326-41dc-95fe-6d2fcadc06e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:44:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:05 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:44:05 user nova-compute[73627]: INFO nova.compute.claims [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Claim successful on node user
Aug 26 16:44:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:05 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:44:06 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:44:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:44:06 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Creating image(s)
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "/opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "/opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "/opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG nova.policy [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65e9557ef8a44c1dbd6f3889f3dd3586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06fa96cd11e64d2083b9ce6f331ac19c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.194s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk 1073741824" returned: 0 in 0.059s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.214s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:44:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:44:07 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Successfully created port: 13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:44:07 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:44:07 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Cannot resize image /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:44:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:44:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Ensure instance console log exists: /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:44:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Successfully updated port: 13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "refresh_cache-230d355a-2326-41dc-95fe-6d2fcadc06e2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquired lock "refresh_cache-230d355a-2326-41dc-95fe-6d2fcadc06e2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-cf67a1e4-de97-4c17-be9d-8994021321cb req-e70a3b5e-a1b5-4445-959c-b531095355b5 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Received event network-changed-13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-cf67a1e4-de97-4c17-be9d-8994021321cb req-e70a3b5e-a1b5-4445-959c-b531095355b5 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Refreshing instance network info cache due to event network-changed-13f7eae6-39a7-456c-b359-d3fe4fc026f3. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cf67a1e4-de97-4c17-be9d-8994021321cb req-e70a3b5e-a1b5-4445-959c-b531095355b5 service nova] Acquiring lock "refresh_cache-230d355a-2326-41dc-95fe-6d2fcadc06e2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.network.neutron [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Updating instance_info_cache with network_info: [{"id": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "address": "fa:16:3e:ae:81:6e", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f7eae6-39", "ovs_interfaceid": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Releasing lock "refresh_cache-230d355a-2326-41dc-95fe-6d2fcadc06e2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Instance network_info: |[{"id": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "address": "fa:16:3e:ae:81:6e", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f7eae6-39", "ovs_interfaceid": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cf67a1e4-de97-4c17-be9d-8994021321cb req-e70a3b5e-a1b5-4445-959c-b531095355b5 service nova] Acquired lock "refresh_cache-230d355a-2326-41dc-95fe-6d2fcadc06e2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.network.neutron [req-cf67a1e4-de97-4c17-be9d-8994021321cb req-e70a3b5e-a1b5-4445-959c-b531095355b5 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Refreshing network info cache for port 13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Start _get_guest_xml network_info=[{"id": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "address": "fa:16:3e:ae:81:6e", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f7eae6-39", "ovs_interfaceid": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:44:08 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:44:08 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1021305047',display_name='tempest-VolumesActionsTest-instance-1021305047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1021305047',id=39,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fa96cd11e64d2083b9ce6f331ac19c',ramdisk_id='',reservation_id='r-4a5cc50u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1696244677',owner_user_name='tempest-VolumesActionsTest-1696244677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:44:06Z,user_data=None,user_id='65e9557ef8a44c1dbd6f3889f3dd3586',uuid=230d355a-2326-41dc-95fe-6d2fcadc06e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "address": "fa:16:3e:ae:81:6e", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f7eae6-39", "ovs_interfaceid": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converting VIF {"id": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "address": "fa:16:3e:ae:81:6e", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f7eae6-39", "ovs_interfaceid": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=13f7eae6-39a7-456c-b359-d3fe4fc026f3,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f7eae6-39') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.objects.instance [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lazy-loading 'pci_devices' on Instance uuid 230d355a-2326-41dc-95fe-6d2fcadc06e2 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:44:08 user nova-compute[73627]:   <uuid>230d355a-2326-41dc-95fe-6d2fcadc06e2</uuid>
Aug 26 16:44:08 user nova-compute[73627]:   <name>instance-00000027</name>
Aug 26 16:44:08 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:44:08 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:44:08 user nova-compute[73627]:   <metadata>
Aug 26 16:44:08 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:44:08 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:44:08 user nova-compute[73627]:       <nova:name>tempest-VolumesActionsTest-instance-1021305047</nova:name>
Aug 26 16:44:08 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:44:08</nova:creationTime>
Aug 26 16:44:08 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:44:08 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:44:08 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:44:08 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:44:08 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:44:08 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:44:08 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:44:08 user nova-compute[73627]:       <nova:owner>
Aug 26 16:44:08 user nova-compute[73627]:         <nova:user uuid="65e9557ef8a44c1dbd6f3889f3dd3586">tempest-VolumesActionsTest-1696244677-project-member</nova:user>
Aug 26 16:44:08 user nova-compute[73627]:         <nova:project uuid="06fa96cd11e64d2083b9ce6f331ac19c">tempest-VolumesActionsTest-1696244677</nova:project>
Aug 26 16:44:08 user nova-compute[73627]:       </nova:owner>
Aug 26 16:44:08 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:44:08 user nova-compute[73627]:       <nova:ports>
Aug 26 16:44:08 user nova-compute[73627]:         <nova:port uuid="13f7eae6-39a7-456c-b359-d3fe4fc026f3">
Aug 26 16:44:08 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 16:44:08 user nova-compute[73627]:         </nova:port>
Aug 26 16:44:08 user nova-compute[73627]:       </nova:ports>
Aug 26 16:44:08 user nova-compute[73627]:     </nova:instance>
Aug 26 16:44:08 user nova-compute[73627]:   </metadata>
Aug 26 16:44:08 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:44:08 user nova-compute[73627]:     <system>
Aug 26 16:44:08 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:44:08 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:44:08 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:44:08 user nova-compute[73627]:       <entry name="serial">230d355a-2326-41dc-95fe-6d2fcadc06e2</entry>
Aug 26 16:44:08 user nova-compute[73627]:       <entry name="uuid">230d355a-2326-41dc-95fe-6d2fcadc06e2</entry>
Aug 26 16:44:08 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:44:08 user nova-compute[73627]:     </system>
Aug 26 16:44:08 user nova-compute[73627]:   </sysinfo>
Aug 26 16:44:08 user nova-compute[73627]:   <os>
Aug 26 16:44:08 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:44:08 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:44:08 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:44:08 user nova-compute[73627]:   </os>
Aug 26 16:44:08 user nova-compute[73627]:   <features>
Aug 26 16:44:08 user nova-compute[73627]:     <acpi/>
Aug 26 16:44:08 user nova-compute[73627]:     <apic/>
Aug 26 16:44:08 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:44:08 user nova-compute[73627]:   </features>
Aug 26 16:44:08 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:44:08 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:44:08 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:44:08 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:44:08 user nova-compute[73627]:   </clock>
Aug 26 16:44:08 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:44:08 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:44:08 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:44:08 user nova-compute[73627]:   </cpu>
Aug 26 16:44:08 user nova-compute[73627]:   <devices>
Aug 26 16:44:08 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:44:08 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:44:08 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk"/>
Aug 26 16:44:08 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:44:08 user nova-compute[73627]:     </disk>
Aug 26 16:44:08 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:44:08 user nova-compute[73627]:       <mac address="fa:16:3e:ae:81:6e"/>
Aug 26 16:44:08 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:44:08 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:44:08 user nova-compute[73627]:       <target dev="tap13f7eae6-39"/>
Aug 26 16:44:08 user nova-compute[73627]:     </interface>
Aug 26 16:44:08 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:44:08 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/console.log" append="off"/>
Aug 26 16:44:08 user nova-compute[73627]:     </serial>
Aug 26 16:44:08 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:44:08 user nova-compute[73627]:     <video>
Aug 26 16:44:08 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:44:08 user nova-compute[73627]:     </video>
Aug 26 16:44:08 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:44:08 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:44:08 user nova-compute[73627]:     </rng>
Aug 26 16:44:08 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:44:08 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:44:08 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:44:08 user nova-compute[73627]:     </memballoon>
Aug 26 16:44:08 user nova-compute[73627]:   </devices>
Aug 26 16:44:08 user nova-compute[73627]: </domain>
Aug 26 16:44:08 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1021305047',display_name='tempest-VolumesActionsTest-instance-1021305047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1021305047',id=39,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06fa96cd11e64d2083b9ce6f331ac19c',ramdisk_id='',reservation_id='r-4a5cc50u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1696244677',owner_user_name='tempest-VolumesActionsTest-1696244677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:44:06Z,user_data=None,user_id='65e9557ef8a44c1dbd6f3889f3dd3586',uuid=230d355a-2326-41dc-95fe-6d2fcadc06e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "address": "fa:16:3e:ae:81:6e", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f7eae6-39", "ovs_interfaceid": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converting VIF {"id": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "address": "fa:16:3e:ae:81:6e", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f7eae6-39", "ovs_interfaceid": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=13f7eae6-39a7-456c-b359-d3fe4fc026f3,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f7eae6-39') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG os_vif [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=13f7eae6-39a7-456c-b359-d3fe4fc026f3,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f7eae6-39') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13f7eae6-39, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13f7eae6-39, col_values=(('external_ids', {'iface-id': '13f7eae6-39a7-456c-b359-d3fe4fc026f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:81:6e', 'vm-uuid': '230d355a-2326-41dc-95fe-6d2fcadc06e2'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:08 user nova-compute[73627]: INFO os_vif [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=13f7eae6-39a7-456c-b359-d3fe4fc026f3,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f7eae6-39')
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:44:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] No VIF found with MAC fa:16:3e:ae:81:6e, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:44:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-cf67a1e4-de97-4c17-be9d-8994021321cb req-e70a3b5e-a1b5-4445-959c-b531095355b5 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Updated VIF entry in instance network info cache for port 13f7eae6-39a7-456c-b359-d3fe4fc026f3. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:44:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-cf67a1e4-de97-4c17-be9d-8994021321cb req-e70a3b5e-a1b5-4445-959c-b531095355b5 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Updating instance_info_cache with network_info: [{"id": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "address": "fa:16:3e:ae:81:6e", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f7eae6-39", "ovs_interfaceid": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:44:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cf67a1e4-de97-4c17-be9d-8994021321cb req-e70a3b5e-a1b5-4445-959c-b531095355b5 service nova] Releasing lock "refresh_cache-230d355a-2326-41dc-95fe-6d2fcadc06e2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-9fdb4c61-ad5a-4ad2-adda-73f0ea03db53 req-2a54da47-e1a4-47ad-a887-9cf206c0526b service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Received event network-vif-plugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9fdb4c61-ad5a-4ad2-adda-73f0ea03db53 req-2a54da47-e1a4-47ad-a887-9cf206c0526b service nova] Acquiring lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9fdb4c61-ad5a-4ad2-adda-73f0ea03db53 req-2a54da47-e1a4-47ad-a887-9cf206c0526b service nova] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9fdb4c61-ad5a-4ad2-adda-73f0ea03db53 req-2a54da47-e1a4-47ad-a887-9cf206c0526b service nova] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-9fdb4c61-ad5a-4ad2-adda-73f0ea03db53 req-2a54da47-e1a4-47ad-a887-9cf206c0526b service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] No waiting events found dispatching network-vif-plugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:44:10 user nova-compute[73627]: WARNING nova.compute.manager [req-9fdb4c61-ad5a-4ad2-adda-73f0ea03db53 req-2a54da47-e1a4-47ad-a887-9cf206c0526b service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Received unexpected event network-vif-plugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 for instance with vm_state building and task_state spawning.
Aug 26 16:44:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Going to confirm migration 2 {{(pid=73627) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquired lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'info_cache' on Instance uuid e9e10c2f-8248-444e-a61a-e2997afde4a4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-790cece2-5bdc-47fc-88ac-d81bab6f81ca req-b3df0974-e56e-43f0-8c4c-f102cbf793e9 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Received event network-vif-plugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-790cece2-5bdc-47fc-88ac-d81bab6f81ca req-b3df0974-e56e-43f0-8c4c-f102cbf793e9 service nova] Acquiring lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-790cece2-5bdc-47fc-88ac-d81bab6f81ca req-b3df0974-e56e-43f0-8c4c-f102cbf793e9 service nova] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-790cece2-5bdc-47fc-88ac-d81bab6f81ca req-b3df0974-e56e-43f0-8c4c-f102cbf793e9 service nova] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-790cece2-5bdc-47fc-88ac-d81bab6f81ca req-b3df0974-e56e-43f0-8c4c-f102cbf793e9 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] No waiting events found dispatching network-vif-plugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:44:12 user nova-compute[73627]: WARNING nova.compute.manager [req-790cece2-5bdc-47fc-88ac-d81bab6f81ca req-b3df0974-e56e-43f0-8c4c-f102cbf793e9 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Received unexpected event network-vif-plugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 for instance with vm_state building and task_state spawning.
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068252.3903446, 230d355a-2326-41dc-95fe-6d2fcadc06e2 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:44:12 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] VM Resumed (Lifecycle Event)
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:44:12 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Instance spawned successfully.
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:44:12 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068252.3925273, 230d355a-2326-41dc-95fe-6d2fcadc06e2 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:44:12 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] VM Started (Lifecycle Event)
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:44:12 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:44:12 user nova-compute[73627]: INFO nova.compute.manager [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Took 6.26 seconds to spawn the instance on the hypervisor.
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:44:12 user nova-compute[73627]: INFO nova.compute.manager [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Took 6.90 seconds to build instance.
Aug 26 16:44:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-bc40321a-69d3-40ae-b893-be06a23887ac tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.017s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updating instance_info_cache with network_info: [{"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Releasing lock "refresh_cache-e9e10c2f-8248-444e-a61a-e2997afde4a4" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'migration_context' on Instance uuid e9e10c2f-8248-444e-a61a-e2997afde4a4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG nova.objects.base [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Object Instance<e9e10c2f-8248-444e-a61a-e2997afde4a4> lazy-loaded attributes: info_cache,migration_context {{(pid=73627) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:13 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:44:13 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:44:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.344s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:13 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Deleted allocation for migration 21f4864c-c48a-49ca-b092-ccfb75c636af
Aug 26 16:44:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b262c66c-70b8-4bf5-9754-55b3e40768f0 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.663s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:16 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:18 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:20 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:44:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:44:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:44:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:44:22 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:44:22 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8069MB free_disk=25.325000762939453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance e9e10c2f-8248-444e-a61a-e2997afde4a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 06a4f983-1867-4156-b2c2-f34bde5e3077 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 230d355a-2326-41dc-95fe-6d2fcadc06e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing inventories for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating ProviderTree inventory for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating inventory in ProviderTree for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing aggregate associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, aggregates: None {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 16:44:22 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing trait associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 16:44:23 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:44:23 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:44:23 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:44:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:25 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:25 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:44:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:44:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:44:25 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:44:26 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updating instance_info_cache with network_info: [{"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:44:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:44:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:44:26 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:26 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:26 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:44:26 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73627) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 16:44:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:28 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 16:44:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] There are 0 instances to clean {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 16:44:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:35 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:44:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:44:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:44:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:44:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:44:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:44:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:44:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:44:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:44:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "06a4f983-1867-4156-b2c2-f34bde5e3077" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:44:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:44:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:44:59 user nova-compute[73627]: INFO nova.compute.manager [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Terminating instance
Aug 26 16:44:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:44:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:44:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-c57a0efb-8bce-40b2-8db9-2b178627cee6 req-4b1bec57-fbbf-4254-a40c-08fc1774a0f9 service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Received event network-vif-unplugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c57a0efb-8bce-40b2-8db9-2b178627cee6 req-4b1bec57-fbbf-4254-a40c-08fc1774a0f9 service nova] Acquiring lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c57a0efb-8bce-40b2-8db9-2b178627cee6 req-4b1bec57-fbbf-4254-a40c-08fc1774a0f9 service nova] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-c57a0efb-8bce-40b2-8db9-2b178627cee6 req-4b1bec57-fbbf-4254-a40c-08fc1774a0f9 service nova] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-c57a0efb-8bce-40b2-8db9-2b178627cee6 req-4b1bec57-fbbf-4254-a40c-08fc1774a0f9 service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] No waiting events found dispatching network-vif-unplugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-c57a0efb-8bce-40b2-8db9-2b178627cee6 req-4b1bec57-fbbf-4254-a40c-08fc1774a0f9 service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Received event network-vif-unplugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:45:00 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Instance destroyed successfully.
Aug 26 16:45:00 user nova-compute[73627]: DEBUG nova.objects.instance [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'resources' on Instance uuid 06a4f983-1867-4156-b2c2-f34bde5e3077 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2111848364',display_name='tempest-TestVolumeBootPattern-server-2111848364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2111848364',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-dtv6aybn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:43:40Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=06a4f983-1867-4156-b2c2-f34bde5e3077,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "address": "fa:16:3e:03:b6:24", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60d9ba8a-f5", "ovs_interfaceid": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "address": "fa:16:3e:03:b6:24", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60d9ba8a-f5", "ovs_interfaceid": "60d9ba8a-f563-4a51-a0cd-8f99b741e131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b6:24,bridge_name='br-int',has_traffic_filtering=True,id=60d9ba8a-f563-4a51-a0cd-8f99b741e131,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60d9ba8a-f5') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_vif [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b6:24,bridge_name='br-int',has_traffic_filtering=True,id=60d9ba8a-f563-4a51-a0cd-8f99b741e131,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60d9ba8a-f5') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60d9ba8a-f5, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:00 user nova-compute[73627]: INFO os_vif [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b6:24,bridge_name='br-int',has_traffic_filtering=True,id=60d9ba8a-f563-4a51-a0cd-8f99b741e131,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60d9ba8a-f5')
Aug 26 16:45:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NieCvXJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:45:00 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7df289-2b39-4a1b-9353-1f5b727c972e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f10c0-f245-4d95-a5eb-413ee225245e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:45:00 user nova-compute[73627]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)
Aug 26 16:45:00 user nova-compute[73627]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d (non-flash)
Aug 26 16:45:00 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:45:00 user nova-compute[73627]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)
Aug 26 16:45:00 user nova-compute[73627]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d (non-flash)
Aug 26 16:45:00 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d029dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d'): ({'sdd'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Removing single pathed devices sdd {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b977ed-539b-444c-8fa3-efaa46b42128]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[054c5b78-3a08-4b22-b068-9a3a5aee0413]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flushing IO for device /dev/sdd {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8266ed32-2ee1-448b-b4b2-f7af259fc4d3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bbcc70-9bdd-4b9a-94da-f88ee8b5712e]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c0dea4eb', '/dev/disk/by-id/scsi-23862643636353462', '/dev/disk/by-id/scsi-1SCST_BIOc0dea4eb-8bd6654b1871c617') {{(pid=84800) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 16:45:00 user nova-compute[73627]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c0dea4eb
Aug 26 16:45:00 user nova-compute[73627]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23862643636353462
Aug 26 16:45:00 user nova-compute[73627]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc0dea4eb-8bd6654b1871c617
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4863175-7853-42a0-a4de-33834286dfd2]: (4, None) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6a1bdf-21b4-4b25-8f0c-91fc5681ab94]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e2a390-c78a-43c8-b266-381dd1008c41]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d, portal: 172.16.0.220,3260]
Aug 26 16:45:00 user nova-compute[73627]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d, portal: 172.16.0.220,3260] successful.
Aug 26 16:45:00 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c81db73-27d9-401b-90a2-28f0271b7a3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b6c2c4-b1f0-4c66-9f56-d71ede29a8b6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== disconnect_volume: return (317ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:45:00 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Deleting instance files /opt/stack/data/nova/instances/06a4f983-1867-4156-b2c2-f34bde5e3077_del
Aug 26 16:45:00 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Deletion of /opt/stack/data/nova/instances/06a4f983-1867-4156-b2c2-f34bde5e3077_del complete
Aug 26 16:45:00 user nova-compute[73627]: INFO nova.compute.manager [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 26 16:45:00 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:45:00 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:45:01 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:45:01 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Took 0.66 seconds to deallocate network for instance.
Aug 26 16:45:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-3f9a58d2-b7a5-44e9-aaa4-93960861830a req-a35266b0-73e0-4671-952e-eda1e5121665 service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Received event network-vif-deleted-60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:45:02 user nova-compute[73627]: INFO nova.compute.manager [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Took 0.78 seconds to detach 1 volumes for instance.
Aug 26 16:45:02 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Deleting volume: 7c81db73-27d9-401b-90a2-28f0271b7a3d {{(pid=73627) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 16:45:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:45:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:45:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-9708eb50-da1f-41f4-9775-6063af6ab3da req-97f92dbe-64f2-4680-9ecf-e15dacc60fbe service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Received event network-vif-plugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:45:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9708eb50-da1f-41f4-9775-6063af6ab3da req-97f92dbe-64f2-4680-9ecf-e15dacc60fbe service nova] Acquiring lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:45:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9708eb50-da1f-41f4-9775-6063af6ab3da req-97f92dbe-64f2-4680-9ecf-e15dacc60fbe service nova] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:45:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9708eb50-da1f-41f4-9775-6063af6ab3da req-97f92dbe-64f2-4680-9ecf-e15dacc60fbe service nova] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:02 user nova-compute[73627]: DEBUG nova.compute.manager [req-9708eb50-da1f-41f4-9775-6063af6ab3da req-97f92dbe-64f2-4680-9ecf-e15dacc60fbe service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] No waiting events found dispatching network-vif-plugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:45:02 user nova-compute[73627]: WARNING nova.compute.manager [req-9708eb50-da1f-41f4-9775-6063af6ab3da req-97f92dbe-64f2-4680-9ecf-e15dacc60fbe service nova] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Received unexpected event network-vif-plugged-60d9ba8a-f563-4a51-a0cd-8f99b741e131 for instance with vm_state deleted and task_state None.
Aug 26 16:45:02 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:45:02 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:45:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:02 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Deleted allocations for instance 06a4f983-1867-4156-b2c2-f34bde5e3077
Aug 26 16:45:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-8094dc01-da84-4f84-adff-d684d7da4f0b tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "06a4f983-1867-4156-b2c2-f34bde5e3077" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.354s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-19fb3f98-b8c8-4356-8688-f68658576762 req-52865fce-1489-43fc-b8d0-237179fb83d2 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-changed-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:45:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-19fb3f98-b8c8-4356-8688-f68658576762 req-52865fce-1489-43fc-b8d0-237179fb83d2 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Refreshing instance network info cache due to event network-changed-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:45:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-19fb3f98-b8c8-4356-8688-f68658576762 req-52865fce-1489-43fc-b8d0-237179fb83d2 service nova] Acquiring lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:45:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-19fb3f98-b8c8-4356-8688-f68658576762 req-52865fce-1489-43fc-b8d0-237179fb83d2 service nova] Acquired lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:45:08 user nova-compute[73627]: DEBUG nova.network.neutron [req-19fb3f98-b8c8-4356-8688-f68658576762 req-52865fce-1489-43fc-b8d0-237179fb83d2 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Refreshing network info cache for port d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:45:08 user nova-compute[73627]: DEBUG nova.network.neutron [req-19fb3f98-b8c8-4356-8688-f68658576762 req-52865fce-1489-43fc-b8d0-237179fb83d2 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updated VIF entry in instance network info cache for port d8ac6436-eeb9-479d-acc8-b244e8f7ceb4. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:45:08 user nova-compute[73627]: DEBUG nova.network.neutron [req-19fb3f98-b8c8-4356-8688-f68658576762 req-52865fce-1489-43fc-b8d0-237179fb83d2 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updating instance_info_cache with network_info: [{"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:45:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-19fb3f98-b8c8-4356-8688-f68658576762 req-52865fce-1489-43fc-b8d0-237179fb83d2 service nova] Releasing lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:45:09 user nova-compute[73627]: INFO nova.compute.manager [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Detaching volume ba92766d-73cb-4f42-80c0-4320efec34d8
Aug 26 16:45:09 user nova-compute[73627]: INFO nova.virt.block_device [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Attempting to driver detach volume ba92766d-73cb-4f42-80c0-4320efec34d8 from mountpoint /dev/vdb
Aug 26 16:45:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Attempting to detach device vdb from instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:45:09 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:45:09 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:45:09 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:45:09 user nova-compute[73627]:   <serial>ba92766d-73cb-4f42-80c0-4320efec34d8</serial>
Aug 26 16:45:09 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:45:09 user nova-compute[73627]: </disk>
Aug 26 16:45:09 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:45:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Successfully detached device vdb from instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 from the persistent domain config.
Aug 26 16:45:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:45:09 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:45:09 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:45:09 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:45:09 user nova-compute[73627]:   <serial>ba92766d-73cb-4f42-80c0-4320efec34d8</serial>
Aug 26 16:45:09 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:45:09 user nova-compute[73627]: </disk>
Aug 26 16:45:09 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693068309.7167652, 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:45:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Successfully detached device vdb from instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 from the live domain config.
Aug 26 16:45:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spGFqTgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:45:09 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b5a2bf-2892-4eb1-9362-5f17d6c06bca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb297fa-16b0-4fa6-b427-74757c95820a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:45:09 user nova-compute[73627]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)
Aug 26 16:45:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:45:09 user nova-compute[73627]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 (non-flash)
Aug 26 16:45:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d0240820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcf20cd-e316-4187-8cdc-46ee5c906a22]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de305c1-0e17-4a4b-aaae-2fbfea600752]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9bb374-58f5-4031-94fa-887d9b53756e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[130389f5-369d-4c3a-8aca-8524d920b03e]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e749b471-63b4-45bd-b57a-6a0287cc2023]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[402d4378-eb4e-4f17-810f-d6600302e588]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8, portal: 172.16.0.220,3260]
Aug 26 16:45:09 user nova-compute[73627]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8, portal: 172.16.0.220,3260] successful.
Aug 26 16:45:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba92766d-73cb-4f42-80c0-4320efec34d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a40a57-53b3-4c85-b605-c4e3fa4fcc8d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] <== disconnect_volume: return (297ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-0fa0f970-acbb-4513-8871-61b88015dfa9 req-394cbe13-179e-48b8-aea8-ab7537b579e9 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-changed-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-0fa0f970-acbb-4513-8871-61b88015dfa9 req-394cbe13-179e-48b8-aea8-ab7537b579e9 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Refreshing instance network info cache due to event network-changed-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0fa0f970-acbb-4513-8871-61b88015dfa9 req-394cbe13-179e-48b8-aea8-ab7537b579e9 service nova] Acquiring lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0fa0f970-acbb-4513-8871-61b88015dfa9 req-394cbe13-179e-48b8-aea8-ab7537b579e9 service nova] Acquired lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG nova.network.neutron [req-0fa0f970-acbb-4513-8871-61b88015dfa9 req-394cbe13-179e-48b8-aea8-ab7537b579e9 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Refreshing network info cache for port d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG nova.network.neutron [req-0fa0f970-acbb-4513-8871-61b88015dfa9 req-394cbe13-179e-48b8-aea8-ab7537b579e9 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updated VIF entry in instance network info cache for port d8ac6436-eeb9-479d-acc8-b244e8f7ceb4. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG nova.network.neutron [req-0fa0f970-acbb-4513-8871-61b88015dfa9 req-394cbe13-179e-48b8-aea8-ab7537b579e9 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updating instance_info_cache with network_info: [{"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0fa0f970-acbb-4513-8871-61b88015dfa9 req-394cbe13-179e-48b8-aea8-ab7537b579e9 service nova] Releasing lock "refresh_cache-0f18cdfa-972f-4f54-bf3b-8290a5407fd2" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'flavor' on Instance uuid 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:45:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9f541516-ef92-4fec-b5cf-fcfd136827f3 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.620s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:13 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:45:14 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:45:15 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068300.2542982, 06a4f983-1867-4156-b2c2-f34bde5e3077 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:45:15 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] VM Stopped (Lifecycle Event)
Aug 26 16:45:15 user nova-compute[73627]: DEBUG nova.compute.manager [None req-2d7ea1e9-99d5-4ed8-9941-48446d4c035f None None] [instance: 06a4f983-1867-4156-b2c2-f34bde5e3077] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:45:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:17 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:45:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:45:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:45:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:45:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:45:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:45:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:45:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:45:22 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 16:45:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:45:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:45:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:45:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:22 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:45:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:45:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:45:24 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:45:24 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:45:24 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8238MB free_disk=25.27782440185547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance e9e10c2f-8248-444e-a61a-e2997afde4a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 230d355a-2326-41dc-95fe-6d2fcadc06e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:45:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:26 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:45:26 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:45:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:45:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:45:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:32 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:45:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "230d355a-2326-41dc-95fe-6d2fcadc06e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:56 user nova-compute[73627]: INFO nova.compute.manager [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Terminating instance
Aug 26 16:45:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-9c4749e4-4ac2-465e-902f-0e8063c48663 req-e150b498-bae4-4a4b-8de5-25af2d7e35b3 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Received event network-vif-unplugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9c4749e4-4ac2-465e-902f-0e8063c48663 req-e150b498-bae4-4a4b-8de5-25af2d7e35b3 service nova] Acquiring lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9c4749e4-4ac2-465e-902f-0e8063c48663 req-e150b498-bae4-4a4b-8de5-25af2d7e35b3 service nova] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9c4749e4-4ac2-465e-902f-0e8063c48663 req-e150b498-bae4-4a4b-8de5-25af2d7e35b3 service nova] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-9c4749e4-4ac2-465e-902f-0e8063c48663 req-e150b498-bae4-4a4b-8de5-25af2d7e35b3 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] No waiting events found dispatching network-vif-unplugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG nova.compute.manager [req-9c4749e4-4ac2-465e-902f-0e8063c48663 req-e150b498-bae4-4a4b-8de5-25af2d7e35b3 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Received event network-vif-unplugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:45:56 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Instance destroyed successfully.
Aug 26 16:45:56 user nova-compute[73627]: DEBUG nova.objects.instance [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lazy-loading 'resources' on Instance uuid 230d355a-2326-41dc-95fe-6d2fcadc06e2 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1021305047',display_name='tempest-VolumesActionsTest-instance-1021305047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1021305047',id=39,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06fa96cd11e64d2083b9ce6f331ac19c',ramdisk_id='',reservation_id='r-4a5cc50u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1696244677',owner_user_name='tempest-VolumesActionsTest-1696244677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:44:13Z,user_data=None,user_id='65e9557ef8a44c1dbd6f3889f3dd3586',uuid=230d355a-2326-41dc-95fe-6d2fcadc06e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "address": "fa:16:3e:ae:81:6e", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f7eae6-39", "ovs_interfaceid": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converting VIF {"id": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "address": "fa:16:3e:ae:81:6e", "network": {"id": "0f0b7647-6ccb-41a4-992c-631f1e53d123", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1420876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06fa96cd11e64d2083b9ce6f331ac19c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f7eae6-39", "ovs_interfaceid": "13f7eae6-39a7-456c-b359-d3fe4fc026f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=13f7eae6-39a7-456c-b359-d3fe4fc026f3,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f7eae6-39') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG os_vif [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=13f7eae6-39a7-456c-b359-d3fe4fc026f3,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f7eae6-39') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13f7eae6-39, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:45:56 user nova-compute[73627]: INFO os_vif [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:81:6e,bridge_name='br-int',has_traffic_filtering=True,id=13f7eae6-39a7-456c-b359-d3fe4fc026f3,network=Network(0f0b7647-6ccb-41a4-992c-631f1e53d123),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13f7eae6-39')
Aug 26 16:45:56 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Deleting instance files /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2_del
Aug 26 16:45:56 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Deletion of /opt/stack/data/nova/instances/230d355a-2326-41dc-95fe-6d2fcadc06e2_del complete
Aug 26 16:45:57 user nova-compute[73627]: INFO nova.compute.manager [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 26 16:45:57 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:45:57 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:45:57 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:45:57 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:45:57 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Took 0.63 seconds to deallocate network for instance.
Aug 26 16:45:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-5fa6b3c5-9534-44ee-9a34-ef92ff816377 req-9e8d13e9-e831-45d6-983a-1a4718b96768 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Received event network-vif-deleted-13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:45:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:45:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:45:57 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:45:57 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:45:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:58 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Deleted allocations for instance 230d355a-2326-41dc-95fe-6d2fcadc06e2
Aug 26 16:45:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cc24191f-ac70-4a05-b079-3296d6a5ded5 tempest-VolumesActionsTest-1696244677 tempest-VolumesActionsTest-1696244677-project-member] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.803s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-f5a302c7-3a63-43ed-a9f8-99a266a103db req-36458228-7983-481c-a989-1c53fe9f3391 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Received event network-vif-plugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:45:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f5a302c7-3a63-43ed-a9f8-99a266a103db req-36458228-7983-481c-a989-1c53fe9f3391 service nova] Acquiring lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:45:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f5a302c7-3a63-43ed-a9f8-99a266a103db req-36458228-7983-481c-a989-1c53fe9f3391 service nova] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:45:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f5a302c7-3a63-43ed-a9f8-99a266a103db req-36458228-7983-481c-a989-1c53fe9f3391 service nova] Lock "230d355a-2326-41dc-95fe-6d2fcadc06e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:45:58 user nova-compute[73627]: DEBUG nova.compute.manager [req-f5a302c7-3a63-43ed-a9f8-99a266a103db req-36458228-7983-481c-a989-1c53fe9f3391 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] No waiting events found dispatching network-vif-plugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:45:58 user nova-compute[73627]: WARNING nova.compute.manager [req-f5a302c7-3a63-43ed-a9f8-99a266a103db req-36458228-7983-481c-a989-1c53fe9f3391 service nova] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Received unexpected event network-vif-plugged-13f7eae6-39a7-456c-b359-d3fe4fc026f3 for instance with vm_state deleted and task_state None.
Aug 26 16:46:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:03 user nova-compute[73627]: INFO nova.compute.manager [None req-0888c673-4cd0-4df1-9bac-bea5638027bf tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Get console output
Aug 26 16:46:03 user nova-compute[73627]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 26 16:46:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:08 user nova-compute[73627]: INFO nova.compute.manager [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Terminating instance
Aug 26 16:46:08 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-fe9ffcc0-4997-42b1-be29-fe18cdf5267a req-a2ea0428-b5e2-41f5-8dc8-b9dee40d8ca1 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-vif-unplugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fe9ffcc0-4997-42b1-be29-fe18cdf5267a req-a2ea0428-b5e2-41f5-8dc8-b9dee40d8ca1 service nova] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fe9ffcc0-4997-42b1-be29-fe18cdf5267a req-a2ea0428-b5e2-41f5-8dc8-b9dee40d8ca1 service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fe9ffcc0-4997-42b1-be29-fe18cdf5267a req-a2ea0428-b5e2-41f5-8dc8-b9dee40d8ca1 service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-fe9ffcc0-4997-42b1-be29-fe18cdf5267a req-a2ea0428-b5e2-41f5-8dc8-b9dee40d8ca1 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] No waiting events found dispatching network-vif-unplugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:46:08 user nova-compute[73627]: DEBUG nova.compute.manager [req-fe9ffcc0-4997-42b1-be29-fe18cdf5267a req-a2ea0428-b5e2-41f5-8dc8-b9dee40d8ca1 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-vif-unplugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Instance destroyed successfully.
Aug 26 16:46:09 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lazy-loading 'resources' on Instance uuid 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-716097931',display_name='tempest-TestMinimumBasicScenario-server-716097931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-716097931',id=36,image_ref='efe7a643-29f1-44d6-b009-64726366e933',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFk4MdcqSuLzRBaShjQKxAFbPE2mLt4jSg3cw0bvfodEGADYPKGXoJpBn6Xv0rpN+FExFr5rNX3dRpjjunTbhYhSoaS+g3HeUj3AAFCHOLq71ODWpNJNLBudahFifz93A==',key_name='tempest-TestMinimumBasicScenario-467026074',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:41:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c5a07134941420ba915917e23449851',ramdisk_id='',reservation_id='r-alrckhp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='efe7a643-29f1-44d6-b009-64726366e933',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-808712581',owner_user_name='tempest-TestMinimumBasicScenario-808712581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:43:24Z,user_data=None,user_id='a676ca6fc331417d8f835ebcf8181cfb',uuid=0f18cdfa-972f-4f54-bf3b-8290a5407fd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converting VIF {"id": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "address": "fa:16:3e:77:d4:68", "network": {"id": "02c17c7a-44f0-4ea5-b906-c05ece868eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2109210301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c5a07134941420ba915917e23449851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac6436-ee", "ovs_interfaceid": "d8ac6436-eeb9-479d-acc8-b244e8f7ceb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:d4:68,bridge_name='br-int',has_traffic_filtering=True,id=d8ac6436-eeb9-479d-acc8-b244e8f7ceb4,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac6436-ee') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG os_vif [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:d4:68,bridge_name='br-int',has_traffic_filtering=True,id=d8ac6436-eeb9-479d-acc8-b244e8f7ceb4,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac6436-ee') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8ac6436-ee, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:46:09 user nova-compute[73627]: INFO os_vif [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:d4:68,bridge_name='br-int',has_traffic_filtering=True,id=d8ac6436-eeb9-479d-acc8-b244e8f7ceb4,network=Network(02c17c7a-44f0-4ea5-b906-c05ece868eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac6436-ee')
Aug 26 16:46:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Deleting instance files /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2_del
Aug 26 16:46:09 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Deletion of /opt/stack/data/nova/instances/0f18cdfa-972f-4f54-bf3b-8290a5407fd2_del complete
Aug 26 16:46:09 user nova-compute[73627]: INFO nova.compute.manager [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 16:46:09 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-b8dd9387-32da-4ed9-b16a-a6e19782ac7d req-bbf5dc38-7827-48cf-83c3-0046ffd97524 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-vif-deleted-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:46:09 user nova-compute[73627]: INFO nova.compute.manager [req-b8dd9387-32da-4ed9-b16a-a6e19782ac7d req-bbf5dc38-7827-48cf-83c3-0046ffd97524 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Neutron deleted interface d8ac6436-eeb9-479d-acc8-b244e8f7ceb4; detaching it from the instance and deleting it from the info cache
Aug 26 16:46:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-b8dd9387-32da-4ed9-b16a-a6e19782ac7d req-bbf5dc38-7827-48cf-83c3-0046ffd97524 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:46:09 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Took 0.61 seconds to deallocate network for instance.
Aug 26 16:46:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-b8dd9387-32da-4ed9-b16a-a6e19782ac7d req-bbf5dc38-7827-48cf-83c3-0046ffd97524 service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Detach interface failed, port_id=d8ac6436-eeb9-479d-acc8-b244e8f7ceb4, reason: Instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:10 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:46:10 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:46:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:10 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Deleted allocations for instance 0f18cdfa-972f-4f54-bf3b-8290a5407fd2
Aug 26 16:46:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4a341689-fd9a-46b4-981f-dd67d465c1a0 tempest-TestMinimumBasicScenario-808712581 tempest-TestMinimumBasicScenario-808712581-project-member] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.900s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-3dc713c4-f829-4aaa-b8f5-cf333668ca70 req-108e98a1-935c-41a3-a589-6abe28549fec service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:46:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3dc713c4-f829-4aaa-b8f5-cf333668ca70 req-108e98a1-935c-41a3-a589-6abe28549fec service nova] Acquiring lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3dc713c4-f829-4aaa-b8f5-cf333668ca70 req-108e98a1-935c-41a3-a589-6abe28549fec service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3dc713c4-f829-4aaa-b8f5-cf333668ca70 req-108e98a1-935c-41a3-a589-6abe28549fec service nova] Lock "0f18cdfa-972f-4f54-bf3b-8290a5407fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:10 user nova-compute[73627]: DEBUG nova.compute.manager [req-3dc713c4-f829-4aaa-b8f5-cf333668ca70 req-108e98a1-935c-41a3-a589-6abe28549fec service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] No waiting events found dispatching network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:46:10 user nova-compute[73627]: WARNING nova.compute.manager [req-3dc713c4-f829-4aaa-b8f5-cf333668ca70 req-108e98a1-935c-41a3-a589-6abe28549fec service nova] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Received unexpected event network-vif-plugged-d8ac6436-eeb9-479d-acc8-b244e8f7ceb4 for instance with vm_state deleted and task_state None.
Aug 26 16:46:11 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068356.9137235, 230d355a-2326-41dc-95fe-6d2fcadc06e2 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:46:11 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] VM Stopped (Lifecycle Event)
Aug 26 16:46:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8a3a9f87-6822-4608-8f1b-ed13519763e9 None None] [instance: 230d355a-2326-41dc-95fe-6d2fcadc06e2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:46:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:46:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:46:18 user nova-compute[73627]: INFO nova.compute.claims [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Claim successful on node user
Aug 26 16:46:18 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:46:18 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:46:18 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:46:18 user nova-compute[73627]: INFO nova.virt.block_device [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Booting with volume 314f6dac-5d65-4d29-a9d7-4dcf3d728723 at /dev/vda
Aug 26 16:46:18 user nova-compute[73627]: DEBUG nova.policy [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c2828f3769d420b9d9caef2e6bc902f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4241157d52c848d49bed0589c2ec725e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG os_brick.utils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb78824-bd30-4be3-a1f3-b2f2feac272e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[299ab067-b7d8-4f6a-b553-d21e50dd3403]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfaa517-84e5-41da-b60c-0370c89c53c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c08c72-8df6-4f31-9949-69b97be78251]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:46:18 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:46:18 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[179a5d66-1d38-4e8e-92de-111fc471a9a7]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG os_brick.utils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:46:18 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Updating existing volume attachment record: fec1a5c0-7e88-4af4-ad22-5311fad37a70 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:46:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Successfully created port: 15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:46:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Successfully updated port: 15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquired lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-6b054e89-572a-477d-aae6-691e7af6d5ea req-6c5735e1-f9eb-4d7c-a125-6c153c9933be service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Received event network-changed-15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-6b054e89-572a-477d-aae6-691e7af6d5ea req-6c5735e1-f9eb-4d7c-a125-6c153c9933be service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Refreshing instance network info cache due to event network-changed-15fa00c5-3dd3-491b-8b5b-07cbd181a381. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6b054e89-572a-477d-aae6-691e7af6d5ea req-6c5735e1-f9eb-4d7c-a125-6c153c9933be service nova] Acquiring lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG nova.network.neutron [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Updating instance_info_cache with network_info: [{"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Releasing lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Instance network_info: |[{"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6b054e89-572a-477d-aae6-691e7af6d5ea req-6c5735e1-f9eb-4d7c-a125-6c153c9933be service nova] Acquired lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:46:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-6b054e89-572a-477d-aae6-691e7af6d5ea req-6c5735e1-f9eb-4d7c-a125-6c153c9933be service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Refreshing network info cache for port 15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:46:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-6b054e89-572a-477d-aae6-691e7af6d5ea req-6c5735e1-f9eb-4d7c-a125-6c153c9933be service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Updated VIF entry in instance network info cache for port 15fa00c5-3dd3-491b-8b5b-07cbd181a381. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:46:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-6b054e89-572a-477d-aae6-691e7af6d5ea req-6c5735e1-f9eb-4d7c-a125-6c153c9933be service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Updating instance_info_cache with network_info: [{"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:46:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6b054e89-572a-477d-aae6-691e7af6d5ea req-6c5735e1-f9eb-4d7c-a125-6c153c9933be service nova] Releasing lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:46:23 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:46:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:46:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:46:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Skipping network cache update for instance because it is Building. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 16:46:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:46:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:46:23 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:46:23 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid c3901966-61e2-4be6-bb8f-bbc449c35b78 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068369.142972, 0f18cdfa-972f-4f54-bf3b-8290a5407fd2 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:46:24 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] VM Stopped (Lifecycle Event)
Aug 26 16:46:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc5318a2-755d-4346-af7a-1988140638c6 None None] [instance: 0f18cdfa-972f-4f54-bf3b-8290a5407fd2] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updating instance_info_cache with network_info: [{"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-c3901966-61e2-4be6-bb8f-bbc449c35b78" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:24 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:25 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:46:25 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:46:25 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8453MB free_disk=25.322437286376953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:46:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:25 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:46:25 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance e9e10c2f-8248-444e-a61a-e2997afde4a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:46:25 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 2ffdcd8b-ac91-4686-82a6-79da99ddb253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:46:25 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:46:25 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:46:25 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:46:25 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:46:25 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:46:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:46:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:46:28 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:46:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:46:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:46:30 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Creating image(s)
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Ensure instance console log exists: /opt/stack/data/nova/instances/2ffdcd8b-ac91-4686-82a6-79da99ddb253/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Start _get_guest_xml network_info=[{"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAkaQnSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ffdcd8b-ac91-4686-82a6-79da99ddb253', 'attached_at': '', 'detached_at': '', 'volume_id': '314f6dac-5d65-4d29-a9d7-4dcf3d728723', 'serial': '314f6dac-5d65-4d29-a9d7-4dcf3d728723'}, 'guest_format': None, 'attachment_id': 'fec1a5c0-7e88-4af4-ad22-5311fad37a70', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:46:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:46:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAkaQnSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:46:30 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:46:30 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:46:30 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a78ab4-168a-4e16-8407-cfeebc75704a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:46:30 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c675d908-3fb3-4b36-a156-9ffa08f720ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723] added
Aug 26 16:46:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0d0e97-562c-46d0-8415-912cf1cef438]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af42137-69a3-483f-8e05-01badbff63e0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAkaQnSw {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAkaQnSw" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[09db3768-ccdc-4708-ba33-83b0e9c90e55]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XAkaQnSw'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd19081-1051-4e11-9ebd-45a4efcea451]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0327fcc7-1b36-459b-ae02-0e66ed973b53]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:46:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:46:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed3f9d6-1ab4-4726-a624-05d45aa0594d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723, portal: 172.16.0.220,3260]
Aug 26 16:46:30 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723, portal: 172.16.0.220,3260] successful.
Aug 26 16:46:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1117d7-cd93-48a1-aedc-18be1954b252]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00f50f3-b1f3-44ea-af86-5f5745dc351a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:46:30 user nova-compute[73627]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:46:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:46:30 user nova-compute[73627]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:46:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e98c909-bd69-4388-9441-25ddc7b4655a]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:46:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAkaQnSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23939303765666236', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939303765666236', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-250811163',display_name='tempest-TestVolumeBootPattern-volume-backed-server-250811163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-250811163',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYg7IOmfKX+uA5znZn3yzQm51fDcPmWADFpvXy60Gs4v1O2mO6J54jjq2IwLwd0EHl+jhnJy2Lb+nMAPBtt1lM7su2taXd4CD3gM/YuGjDQoV3K1Hsv1ISil+0WFfqNvA==',key_name='tempest-keypair-295273271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-fehc7tb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=2ffdcd8b-ac91-4686-82a6-79da99ddb253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:da:e9,bridge_name='br-int',has_traffic_filtering=True,id=15fa00c5-3dd3-491b-8b5b-07cbd181a381,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fa00c5-3d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG nova.objects.instance [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ffdcd8b-ac91-4686-82a6-79da99ddb253 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:46:31 user nova-compute[73627]:   <uuid>2ffdcd8b-ac91-4686-82a6-79da99ddb253</uuid>
Aug 26 16:46:31 user nova-compute[73627]:   <name>instance-00000028</name>
Aug 26 16:46:31 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:46:31 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:46:31 user nova-compute[73627]:   <metadata>
Aug 26 16:46:31 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:46:31 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:46:31 user nova-compute[73627]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-250811163</nova:name>
Aug 26 16:46:31 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:46:30</nova:creationTime>
Aug 26 16:46:31 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:46:31 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:46:31 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:46:31 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:46:31 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:46:31 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:46:31 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:46:31 user nova-compute[73627]:       <nova:owner>
Aug 26 16:46:31 user nova-compute[73627]:         <nova:user uuid="1c2828f3769d420b9d9caef2e6bc902f">tempest-TestVolumeBootPattern-1705344746-project-member</nova:user>
Aug 26 16:46:31 user nova-compute[73627]:         <nova:project uuid="4241157d52c848d49bed0589c2ec725e">tempest-TestVolumeBootPattern-1705344746</nova:project>
Aug 26 16:46:31 user nova-compute[73627]:       </nova:owner>
Aug 26 16:46:31 user nova-compute[73627]:       <nova:ports>
Aug 26 16:46:31 user nova-compute[73627]:         <nova:port uuid="15fa00c5-3dd3-491b-8b5b-07cbd181a381">
Aug 26 16:46:31 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 16:46:31 user nova-compute[73627]:         </nova:port>
Aug 26 16:46:31 user nova-compute[73627]:       </nova:ports>
Aug 26 16:46:31 user nova-compute[73627]:     </nova:instance>
Aug 26 16:46:31 user nova-compute[73627]:   </metadata>
Aug 26 16:46:31 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:46:31 user nova-compute[73627]:     <system>
Aug 26 16:46:31 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:46:31 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:46:31 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:46:31 user nova-compute[73627]:       <entry name="serial">2ffdcd8b-ac91-4686-82a6-79da99ddb253</entry>
Aug 26 16:46:31 user nova-compute[73627]:       <entry name="uuid">2ffdcd8b-ac91-4686-82a6-79da99ddb253</entry>
Aug 26 16:46:31 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:46:31 user nova-compute[73627]:     </system>
Aug 26 16:46:31 user nova-compute[73627]:   </sysinfo>
Aug 26 16:46:31 user nova-compute[73627]:   <os>
Aug 26 16:46:31 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:46:31 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:46:31 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:46:31 user nova-compute[73627]:   </os>
Aug 26 16:46:31 user nova-compute[73627]:   <features>
Aug 26 16:46:31 user nova-compute[73627]:     <acpi/>
Aug 26 16:46:31 user nova-compute[73627]:     <apic/>
Aug 26 16:46:31 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:46:31 user nova-compute[73627]:   </features>
Aug 26 16:46:31 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:46:31 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:46:31 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:46:31 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:46:31 user nova-compute[73627]:   </clock>
Aug 26 16:46:31 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:46:31 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:46:31 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:46:31 user nova-compute[73627]:   </cpu>
Aug 26 16:46:31 user nova-compute[73627]:   <devices>
Aug 26 16:46:31 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:46:31 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:46:31 user nova-compute[73627]:       <source dev="/dev/sdc"/>
Aug 26 16:46:31 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:46:31 user nova-compute[73627]:       <serial>314f6dac-5d65-4d29-a9d7-4dcf3d728723</serial>
Aug 26 16:46:31 user nova-compute[73627]:     </disk>
Aug 26 16:46:31 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:46:31 user nova-compute[73627]:       <mac address="fa:16:3e:72:da:e9"/>
Aug 26 16:46:31 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:46:31 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:46:31 user nova-compute[73627]:       <target dev="tap15fa00c5-3d"/>
Aug 26 16:46:31 user nova-compute[73627]:     </interface>
Aug 26 16:46:31 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:46:31 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/2ffdcd8b-ac91-4686-82a6-79da99ddb253/console.log" append="off"/>
Aug 26 16:46:31 user nova-compute[73627]:     </serial>
Aug 26 16:46:31 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:46:31 user nova-compute[73627]:     <video>
Aug 26 16:46:31 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:46:31 user nova-compute[73627]:     </video>
Aug 26 16:46:31 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:46:31 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:46:31 user nova-compute[73627]:     </rng>
Aug 26 16:46:31 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:46:31 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:46:31 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:46:31 user nova-compute[73627]:     </memballoon>
Aug 26 16:46:31 user nova-compute[73627]:   </devices>
Aug 26 16:46:31 user nova-compute[73627]: </domain>
Aug 26 16:46:31 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-250811163',display_name='tempest-TestVolumeBootPattern-volume-backed-server-250811163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-250811163',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYg7IOmfKX+uA5znZn3yzQm51fDcPmWADFpvXy60Gs4v1O2mO6J54jjq2IwLwd0EHl+jhnJy2Lb+nMAPBtt1lM7su2taXd4CD3gM/YuGjDQoV3K1Hsv1ISil+0WFfqNvA==',key_name='tempest-keypair-295273271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-fehc7tb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=2ffdcd8b-ac91-4686-82a6-79da99ddb253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:da:e9,bridge_name='br-int',has_traffic_filtering=True,id=15fa00c5-3dd3-491b-8b5b-07cbd181a381,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fa00c5-3d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG os_vif [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:da:e9,bridge_name='br-int',has_traffic_filtering=True,id=15fa00c5-3dd3-491b-8b5b-07cbd181a381,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fa00c5-3d') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15fa00c5-3d, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15fa00c5-3d, col_values=(('external_ids', {'iface-id': '15fa00c5-3dd3-491b-8b5b-07cbd181a381', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:da:e9', 'vm-uuid': '2ffdcd8b-ac91-4686-82a6-79da99ddb253'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:31 user nova-compute[73627]: INFO os_vif [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:da:e9,bridge_name='br-int',has_traffic_filtering=True,id=15fa00c5-3dd3-491b-8b5b-07cbd181a381,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fa00c5-3d')
Aug 26 16:46:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:46:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No VIF found with MAC fa:16:3e:72:da:e9, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:46:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:33 user nova-compute[73627]: DEBUG nova.compute.manager [req-3418a768-58a9-4b91-b70d-1b0540abc6a4 req-5d93426c-f301-44fa-ae09-2a74a803f56e service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Received event network-vif-plugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:46:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3418a768-58a9-4b91-b70d-1b0540abc6a4 req-5d93426c-f301-44fa-ae09-2a74a803f56e service nova] Acquiring lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3418a768-58a9-4b91-b70d-1b0540abc6a4 req-5d93426c-f301-44fa-ae09-2a74a803f56e service nova] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3418a768-58a9-4b91-b70d-1b0540abc6a4 req-5d93426c-f301-44fa-ae09-2a74a803f56e service nova] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:33 user nova-compute[73627]: DEBUG nova.compute.manager [req-3418a768-58a9-4b91-b70d-1b0540abc6a4 req-5d93426c-f301-44fa-ae09-2a74a803f56e service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] No waiting events found dispatching network-vif-plugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:46:33 user nova-compute[73627]: WARNING nova.compute.manager [req-3418a768-58a9-4b91-b70d-1b0540abc6a4 req-5d93426c-f301-44fa-ae09-2a74a803f56e service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Received unexpected event network-vif-plugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 for instance with vm_state building and task_state spawning.
Aug 26 16:46:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068395.0978498, 2ffdcd8b-ac91-4686-82a6-79da99ddb253 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:46:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] VM Resumed (Lifecycle Event)
Aug 26 16:46:35 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Instance spawned successfully.
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:46:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068395.0981722, 2ffdcd8b-ac91-4686-82a6-79da99ddb253 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:46:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] VM Started (Lifecycle Event)
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:46:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:46:35 user nova-compute[73627]: INFO nova.compute.manager [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.compute.manager [req-f2365dbf-e167-4da8-937c-486d3ca4f982 req-a3b1348b-179c-471f-88c7-82066ed3fb37 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Received event network-vif-plugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f2365dbf-e167-4da8-937c-486d3ca4f982 req-a3b1348b-179c-471f-88c7-82066ed3fb37 service nova] Acquiring lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f2365dbf-e167-4da8-937c-486d3ca4f982 req-a3b1348b-179c-471f-88c7-82066ed3fb37 service nova] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f2365dbf-e167-4da8-937c-486d3ca4f982 req-a3b1348b-179c-471f-88c7-82066ed3fb37 service nova] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:35 user nova-compute[73627]: DEBUG nova.compute.manager [req-f2365dbf-e167-4da8-937c-486d3ca4f982 req-a3b1348b-179c-471f-88c7-82066ed3fb37 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] No waiting events found dispatching network-vif-plugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:46:35 user nova-compute[73627]: WARNING nova.compute.manager [req-f2365dbf-e167-4da8-937c-486d3ca4f982 req-a3b1348b-179c-471f-88c7-82066ed3fb37 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Received unexpected event network-vif-plugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 for instance with vm_state building and task_state spawning.
Aug 26 16:46:35 user nova-compute[73627]: INFO nova.compute.manager [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Took 17.09 seconds to build instance.
Aug 26 16:46:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-22c7cd1f-79b9-474a-ba08-8a045ea7d763 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.194s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:46:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:46:58 user nova-compute[73627]: INFO nova.compute.claims [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Claim successful on node user
Aug 26 16:46:58 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:46:58 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:46:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG nova.policy [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23b0873451304eefb3eb0f8f01727182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4b851aec5746a68bb6cd57285b133a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:46:58 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Creating image(s)
Aug 26 16:46:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "/opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "/opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "/opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.212s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.231s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk 1073741824" returned: 0 in 0.092s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.202s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Successfully created port: 47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Cannot resize image /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Ensure instance console log exists: /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:46:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Successfully updated port: 47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:47:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:47:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquired lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:47:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:47:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-788e9277-1d1f-4f5e-a304-abf682017709 req-9de28aec-8139-4941-ba73-f80de54a24c5 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received event network-changed-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:47:00 user nova-compute[73627]: DEBUG nova.compute.manager [req-788e9277-1d1f-4f5e-a304-abf682017709 req-9de28aec-8139-4941-ba73-f80de54a24c5 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Refreshing instance network info cache due to event network-changed-47640bf5-754e-4f01-90a7-740813e8498e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:47:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-788e9277-1d1f-4f5e-a304-abf682017709 req-9de28aec-8139-4941-ba73-f80de54a24c5 service nova] Acquiring lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:47:00 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updating instance_info_cache with network_info: [{"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Releasing lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Instance network_info: |[{"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-788e9277-1d1f-4f5e-a304-abf682017709 req-9de28aec-8139-4941-ba73-f80de54a24c5 service nova] Acquired lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-788e9277-1d1f-4f5e-a304-abf682017709 req-9de28aec-8139-4941-ba73-f80de54a24c5 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Refreshing network info cache for port 47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Start _get_guest_xml network_info=[{"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:47:01 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:47:01 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-699243273',display_name='tempest-TestStampPattern-server-699243273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-699243273',id=41,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClm4sbJTbQecTTto7JpLosQLvUWuSSwBPYQ/9eVAIKa4x5C24J3npTbB1xGl2BdK0pMwRzKGeyIQQpilDlIlaAntYzFvMNplr4IkHrgY6/OLLZmaIAY+eAS/bXWwYiwgg==',key_name='tempest-TestStampPattern-599218896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b4b851aec5746a68bb6cd57285b133a',ramdisk_id='',reservation_id='r-ax8t4spe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1807109610',owner_user_name='tempest-TestStampPattern-1807109610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:46:59Z,user_data=None,user_id='23b0873451304eefb3eb0f8f01727182',uuid=faa17ff2-089a-4499-bde5-3b9314b3c4a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converting VIF {"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:46:cf,bridge_name='br-int',has_traffic_filtering=True,id=47640bf5-754e-4f01-90a7-740813e8498e,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47640bf5-75') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.objects.instance [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lazy-loading 'pci_devices' on Instance uuid faa17ff2-089a-4499-bde5-3b9314b3c4a7 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:47:01 user nova-compute[73627]:   <uuid>faa17ff2-089a-4499-bde5-3b9314b3c4a7</uuid>
Aug 26 16:47:01 user nova-compute[73627]:   <name>instance-00000029</name>
Aug 26 16:47:01 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:47:01 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:47:01 user nova-compute[73627]:   <metadata>
Aug 26 16:47:01 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:47:01 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:47:01 user nova-compute[73627]:       <nova:name>tempest-TestStampPattern-server-699243273</nova:name>
Aug 26 16:47:01 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:47:01</nova:creationTime>
Aug 26 16:47:01 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:47:01 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:47:01 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:47:01 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:47:01 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:47:01 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:47:01 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:47:01 user nova-compute[73627]:       <nova:owner>
Aug 26 16:47:01 user nova-compute[73627]:         <nova:user uuid="23b0873451304eefb3eb0f8f01727182">tempest-TestStampPattern-1807109610-project-member</nova:user>
Aug 26 16:47:01 user nova-compute[73627]:         <nova:project uuid="2b4b851aec5746a68bb6cd57285b133a">tempest-TestStampPattern-1807109610</nova:project>
Aug 26 16:47:01 user nova-compute[73627]:       </nova:owner>
Aug 26 16:47:01 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:47:01 user nova-compute[73627]:       <nova:ports>
Aug 26 16:47:01 user nova-compute[73627]:         <nova:port uuid="47640bf5-754e-4f01-90a7-740813e8498e">
Aug 26 16:47:01 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 16:47:01 user nova-compute[73627]:         </nova:port>
Aug 26 16:47:01 user nova-compute[73627]:       </nova:ports>
Aug 26 16:47:01 user nova-compute[73627]:     </nova:instance>
Aug 26 16:47:01 user nova-compute[73627]:   </metadata>
Aug 26 16:47:01 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:47:01 user nova-compute[73627]:     <system>
Aug 26 16:47:01 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:47:01 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:47:01 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:47:01 user nova-compute[73627]:       <entry name="serial">faa17ff2-089a-4499-bde5-3b9314b3c4a7</entry>
Aug 26 16:47:01 user nova-compute[73627]:       <entry name="uuid">faa17ff2-089a-4499-bde5-3b9314b3c4a7</entry>
Aug 26 16:47:01 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:47:01 user nova-compute[73627]:     </system>
Aug 26 16:47:01 user nova-compute[73627]:   </sysinfo>
Aug 26 16:47:01 user nova-compute[73627]:   <os>
Aug 26 16:47:01 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:47:01 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:47:01 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:47:01 user nova-compute[73627]:   </os>
Aug 26 16:47:01 user nova-compute[73627]:   <features>
Aug 26 16:47:01 user nova-compute[73627]:     <acpi/>
Aug 26 16:47:01 user nova-compute[73627]:     <apic/>
Aug 26 16:47:01 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:47:01 user nova-compute[73627]:   </features>
Aug 26 16:47:01 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:47:01 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:47:01 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:47:01 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:47:01 user nova-compute[73627]:   </clock>
Aug 26 16:47:01 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:47:01 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:47:01 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:47:01 user nova-compute[73627]:   </cpu>
Aug 26 16:47:01 user nova-compute[73627]:   <devices>
Aug 26 16:47:01 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:47:01 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:47:01 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk"/>
Aug 26 16:47:01 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:47:01 user nova-compute[73627]:     </disk>
Aug 26 16:47:01 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:47:01 user nova-compute[73627]:       <mac address="fa:16:3e:bb:46:cf"/>
Aug 26 16:47:01 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:47:01 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:47:01 user nova-compute[73627]:       <target dev="tap47640bf5-75"/>
Aug 26 16:47:01 user nova-compute[73627]:     </interface>
Aug 26 16:47:01 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:47:01 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/console.log" append="off"/>
Aug 26 16:47:01 user nova-compute[73627]:     </serial>
Aug 26 16:47:01 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:47:01 user nova-compute[73627]:     <video>
Aug 26 16:47:01 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:47:01 user nova-compute[73627]:     </video>
Aug 26 16:47:01 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:47:01 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:47:01 user nova-compute[73627]:     </rng>
Aug 26 16:47:01 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:47:01 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:47:01 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:47:01 user nova-compute[73627]:     </memballoon>
Aug 26 16:47:01 user nova-compute[73627]:   </devices>
Aug 26 16:47:01 user nova-compute[73627]: </domain>
Aug 26 16:47:01 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-699243273',display_name='tempest-TestStampPattern-server-699243273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-699243273',id=41,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClm4sbJTbQecTTto7JpLosQLvUWuSSwBPYQ/9eVAIKa4x5C24J3npTbB1xGl2BdK0pMwRzKGeyIQQpilDlIlaAntYzFvMNplr4IkHrgY6/OLLZmaIAY+eAS/bXWwYiwgg==',key_name='tempest-TestStampPattern-599218896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b4b851aec5746a68bb6cd57285b133a',ramdisk_id='',reservation_id='r-ax8t4spe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1807109610',owner_user_name='tempest-TestStampPattern-1807109610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:46:59Z,user_data=None,user_id='23b0873451304eefb3eb0f8f01727182',uuid=faa17ff2-089a-4499-bde5-3b9314b3c4a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converting VIF {"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:46:cf,bridge_name='br-int',has_traffic_filtering=True,id=47640bf5-754e-4f01-90a7-740813e8498e,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47640bf5-75') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG os_vif [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:46:cf,bridge_name='br-int',has_traffic_filtering=True,id=47640bf5-754e-4f01-90a7-740813e8498e,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47640bf5-75') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47640bf5-75, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47640bf5-75, col_values=(('external_ids', {'iface-id': '47640bf5-754e-4f01-90a7-740813e8498e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:46:cf', 'vm-uuid': 'faa17ff2-089a-4499-bde5-3b9314b3c4a7'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:01 user nova-compute[73627]: INFO os_vif [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:46:cf,bridge_name='br-int',has_traffic_filtering=True,id=47640bf5-754e-4f01-90a7-740813e8498e,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47640bf5-75')
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] No VIF found with MAC fa:16:3e:bb:46:cf, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-788e9277-1d1f-4f5e-a304-abf682017709 req-9de28aec-8139-4941-ba73-f80de54a24c5 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updated VIF entry in instance network info cache for port 47640bf5-754e-4f01-90a7-740813e8498e. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG nova.network.neutron [req-788e9277-1d1f-4f5e-a304-abf682017709 req-9de28aec-8139-4941-ba73-f80de54a24c5 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updating instance_info_cache with network_info: [{"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:47:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-788e9277-1d1f-4f5e-a304-abf682017709 req-9de28aec-8139-4941-ba73-f80de54a24c5 service nova] Releasing lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:47:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:03 user nova-compute[73627]: DEBUG nova.compute.manager [req-7cf25844-f310-48a5-8b17-c39ff740d7bb req-82d1fb52-6115-4936-af70-6f9cb13cc761 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received event network-vif-plugged-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:47:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf25844-f310-48a5-8b17-c39ff740d7bb req-82d1fb52-6115-4936-af70-6f9cb13cc761 service nova] Acquiring lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf25844-f310-48a5-8b17-c39ff740d7bb req-82d1fb52-6115-4936-af70-6f9cb13cc761 service nova] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7cf25844-f310-48a5-8b17-c39ff740d7bb req-82d1fb52-6115-4936-af70-6f9cb13cc761 service nova] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:03 user nova-compute[73627]: DEBUG nova.compute.manager [req-7cf25844-f310-48a5-8b17-c39ff740d7bb req-82d1fb52-6115-4936-af70-6f9cb13cc761 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] No waiting events found dispatching network-vif-plugged-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:47:03 user nova-compute[73627]: WARNING nova.compute.manager [req-7cf25844-f310-48a5-8b17-c39ff740d7bb req-82d1fb52-6115-4936-af70-6f9cb13cc761 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received unexpected event network-vif-plugged-47640bf5-754e-4f01-90a7-740813e8498e for instance with vm_state building and task_state spawning.
Aug 26 16:47:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:04 user nova-compute[73627]: INFO nova.compute.manager [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Terminating instance
Aug 26 16:47:04 user nova-compute[73627]: DEBUG nova.compute.manager [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:47:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068425.4516692, faa17ff2-089a-4499-bde5-3b9314b3c4a7 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:47:05 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] VM Resumed (Lifecycle Event)
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:47:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Instance spawned successfully.
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received event network-vif-plugged-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] Acquiring lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] No waiting events found dispatching network-vif-plugged-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:47:05 user nova-compute[73627]: WARNING nova.compute.manager [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received unexpected event network-vif-plugged-47640bf5-754e-4f01-90a7-740813e8498e for instance with vm_state building and task_state spawning.
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-vif-unplugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] No waiting events found dispatching network-vif-unplugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-vif-unplugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] Acquiring lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] No waiting events found dispatching network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:47:05 user nova-compute[73627]: WARNING nova.compute.manager [req-9743acab-5c3f-4ebf-a280-d5810b8d7055 req-06c3a9a9-129e-41d8-b772-d8725cea6b9b service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received unexpected event network-vif-plugged-67554b09-a82b-4a0b-8ff7-fb5e47c7031a for instance with vm_state active and task_state deleting.
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:05 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068425.454126, faa17ff2-089a-4499-bde5-3b9314b3c4a7 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:47:05 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] VM Started (Lifecycle Event)
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:47:05 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:47:05 user nova-compute[73627]: INFO nova.compute.manager [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Took 6.67 seconds to spawn the instance on the hypervisor.
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:47:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Instance destroyed successfully.
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.objects.instance [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'resources' on Instance uuid e9e10c2f-8248-444e-a61a-e2997afde4a4 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-148211678',display_name='tempest-ServerActionsTestOtherA-server-148211678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-148211678',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPablajuq8xLBFiX0kjjyHTcUxoq8CZCKKmSQoF/n+RncsJGeKPTG3tFOgrEM0xDUb7dmLLfXVGvvH6d7PuXa2K1fYDVua5anrg1Gw7a6no9azLYSkiUBpYQ6yR/vuL6og==',key_name='tempest-keypair-1189535517',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:42:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-4n7nlqag',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=e9e10c2f-8248-444e-a61a-e2997afde4a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "address": "fa:16:3e:5b:80:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67554b09-a8", "ovs_interfaceid": "67554b09-a82b-4a0b-8ff7-fb5e47c7031a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_vif [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67554b09-a8, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:47:05 user nova-compute[73627]: INFO os_vif [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:80:5d,bridge_name='br-int',has_traffic_filtering=True,id=67554b09-a82b-4a0b-8ff7-fb5e47c7031a,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67554b09-a8')
Aug 26 16:47:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewHBfLkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:47:05 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[200d8d5a-680e-48c9-bd9e-e17197825636]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf8f11-bd51-4995-90c1-528f159b9592]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:47:05 user nova-compute[73627]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:47:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 (non-flash)
Aug 26 16:47:05 user nova-compute[73627]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:47:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d0106200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:05 user nova-compute[73627]: INFO nova.compute.manager [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Took 7.46 seconds to build instance.
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ce3383-a06c-4fea-9af2-ac73570ebfdc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a7621436-9e09-4339-9e46-47e53853f434 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.593s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f77bf9-1a1d-4abd-9983-ed76fab0ba61]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d955d74-667b-47e1-a663-ac4fbffa1609]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9d1fc9-6807-4b6a-a689-502c2d40f54d]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO979dd2c2-b992cd01023751da', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_979dd2c2', '/dev/disk/by-id/scsi-26239393263643031') {{(pid=84800) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb4b48d-7197-4c0f-8cf7-a37cb7c376d2]: (4, None) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5357069a-bc38-4de5-81c8-1106ef27847b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e3ab36-3b69-4bc0-849a-f2dbfd42dcac]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260]
Aug 26 16:47:05 user nova-compute[73627]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508, portal: 172.16.0.220,3260] successful.
Aug 26 16:47:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:47:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:06 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596b99-bdc8-424b-b5bf-55b05a660508 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:06 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d28f56-4c9a-499e-839d-2a231ed855c2]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:47:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:47:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:47:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] <== disconnect_volume: return (324ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:47:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:47:06 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Deleting instance files /opt/stack/data/nova/instances/e9e10c2f-8248-444e-a61a-e2997afde4a4_del
Aug 26 16:47:06 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Deletion of /opt/stack/data/nova/instances/e9e10c2f-8248-444e-a61a-e2997afde4a4_del complete
Aug 26 16:47:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:06 user nova-compute[73627]: INFO nova.compute.manager [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 26 16:47:06 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:47:06 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:47:06 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:47:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:07 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:47:07 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Took 1.29 seconds to deallocate network for instance.
Aug 26 16:47:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-0278c289-e9da-4d2d-ba36-8354b8b94796 req-d8ed9cd9-e34e-4cb0-9ea5-01b720197c8f service nova] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Received event network-vif-deleted-67554b09-a82b-4a0b-8ff7-fb5e47c7031a {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:47:08 user nova-compute[73627]: INFO nova.compute.manager [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Took 0.93 seconds to detach 1 volumes for instance.
Aug 26 16:47:08 user nova-compute[73627]: DEBUG nova.compute.manager [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Deleting volume: 54596b99-bdc8-424b-b5bf-55b05a660508 {{(pid=73627) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 16:47:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:08 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:47:08 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:47:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:08 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Deleted allocations for instance e9e10c2f-8248-444e-a61a-e2997afde4a4
Aug 26 16:47:08 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-61384f17-aedc-406d-80ca-f828b18639df tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "e9e10c2f-8248-444e-a61a-e2997afde4a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.173s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:17 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:47:17 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:47:20 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068425.610052, e9e10c2f-8248-444e-a61a-e2997afde4a4 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:47:20 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] VM Stopped (Lifecycle Event)
Aug 26 16:47:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-bc849fcc-bcf5-4006-b390-565360ba2e6f None None] [instance: e9e10c2f-8248-444e-a61a-e2997afde4a4] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:47:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:47:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:47:23 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:47:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:47:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 16:47:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:25 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:47:25 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:47:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:25 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:47:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:47:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:26 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:27 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:47:27 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:47:27 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8263MB free_disk=25.232208251953125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:47:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:27 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c3901966-61e2-4be6-bb8f-bbc449c35b78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:47:27 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 2ffdcd8b-ac91-4686-82a6-79da99ddb253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:47:27 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:47:27 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:47:27 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:47:27 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:47:27 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:47:28 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:47:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.767s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:30 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:47:30 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:47:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:47:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:35 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:47:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:47:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:47:36 user nova-compute[73627]: INFO nova.compute.claims [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Claim successful on node user
Aug 26 16:47:36 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:47:36 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:47:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:47:37 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:47:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG nova.policy [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3725a470efe84258825ac4db497f6761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1550b44802843dca4d2f8ad38adbc12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:47:37 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Creating image(s)
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "/opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "/opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.245s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.208s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk 1073741824" returned: 0 in 0.054s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:37 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Successfully created port: c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.220s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Cannot resize image /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Ensure instance console log exists: /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Successfully updated port: c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquired lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-13a596f1-a851-4054-bf93-a5b005ddf8c7 req-5b7ca0e4-9d46-42dd-8dfb-d4afc481b4db service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-changed-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-13a596f1-a851-4054-bf93-a5b005ddf8c7 req-5b7ca0e4-9d46-42dd-8dfb-d4afc481b4db service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Refreshing instance network info cache due to event network-changed-c714f5c2-5c80-432c-a360-b689eead7360. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-13a596f1-a851-4054-bf93-a5b005ddf8c7 req-5b7ca0e4-9d46-42dd-8dfb-d4afc481b4db service nova] Acquiring lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:47:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.network.neutron [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Updating instance_info_cache with network_info: [{"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Releasing lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Instance network_info: |[{"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-13a596f1-a851-4054-bf93-a5b005ddf8c7 req-5b7ca0e4-9d46-42dd-8dfb-d4afc481b4db service nova] Acquired lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.network.neutron [req-13a596f1-a851-4054-bf93-a5b005ddf8c7 req-5b7ca0e4-9d46-42dd-8dfb-d4afc481b4db service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Refreshing network info cache for port c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Start _get_guest_xml network_info=[{"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:47:39 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:47:39 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:47:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2061154556',display_name='tempest-VolumesSnapshotTestJSON-instance-2061154556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2061154556',id=42,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgB359csoIAZ/lCAE/y1YujQtoF+PoW2X36uyo8ss0EBB/Kfyl2Ne+B4kal964hjEVfRw4opSYqUM1gRKwya3fsbQWsw3C/M1mPX3lrHvaSAe3jgk4PZtkiNkJtpu2yvw==',key_name='tempest-keypair-1975616310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1550b44802843dca4d2f8ad38adbc12',ramdisk_id='',reservation_id='r-wnzyiox0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-351265767',owner_user_name='tempest-VolumesSnapshotTestJSON-351265767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3725a470efe84258825ac4db497f6761',uuid=4ea0a009-4457-42f6-9c36-7b2325b73071,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converting VIF {"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b5:db,bridge_name='br-int',has_traffic_filtering=True,id=c714f5c2-5c80-432c-a360-b689eead7360,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc714f5c2-5c') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ea0a009-4457-42f6-9c36-7b2325b73071 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:47:39 user nova-compute[73627]:   <uuid>4ea0a009-4457-42f6-9c36-7b2325b73071</uuid>
Aug 26 16:47:39 user nova-compute[73627]:   <name>instance-0000002a</name>
Aug 26 16:47:39 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:47:39 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:47:39 user nova-compute[73627]:   <metadata>
Aug 26 16:47:39 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:47:39 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:47:39 user nova-compute[73627]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2061154556</nova:name>
Aug 26 16:47:39 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:47:39</nova:creationTime>
Aug 26 16:47:39 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:47:39 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:47:39 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:47:39 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:47:39 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:47:39 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:47:39 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:47:39 user nova-compute[73627]:       <nova:owner>
Aug 26 16:47:39 user nova-compute[73627]:         <nova:user uuid="3725a470efe84258825ac4db497f6761">tempest-VolumesSnapshotTestJSON-351265767-project-member</nova:user>
Aug 26 16:47:39 user nova-compute[73627]:         <nova:project uuid="d1550b44802843dca4d2f8ad38adbc12">tempest-VolumesSnapshotTestJSON-351265767</nova:project>
Aug 26 16:47:39 user nova-compute[73627]:       </nova:owner>
Aug 26 16:47:39 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:47:39 user nova-compute[73627]:       <nova:ports>
Aug 26 16:47:39 user nova-compute[73627]:         <nova:port uuid="c714f5c2-5c80-432c-a360-b689eead7360">
Aug 26 16:47:39 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 16:47:39 user nova-compute[73627]:         </nova:port>
Aug 26 16:47:39 user nova-compute[73627]:       </nova:ports>
Aug 26 16:47:39 user nova-compute[73627]:     </nova:instance>
Aug 26 16:47:39 user nova-compute[73627]:   </metadata>
Aug 26 16:47:39 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:47:39 user nova-compute[73627]:     <system>
Aug 26 16:47:39 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:47:39 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:47:39 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:47:39 user nova-compute[73627]:       <entry name="serial">4ea0a009-4457-42f6-9c36-7b2325b73071</entry>
Aug 26 16:47:39 user nova-compute[73627]:       <entry name="uuid">4ea0a009-4457-42f6-9c36-7b2325b73071</entry>
Aug 26 16:47:39 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:47:39 user nova-compute[73627]:     </system>
Aug 26 16:47:39 user nova-compute[73627]:   </sysinfo>
Aug 26 16:47:39 user nova-compute[73627]:   <os>
Aug 26 16:47:39 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:47:39 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:47:39 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:47:39 user nova-compute[73627]:   </os>
Aug 26 16:47:39 user nova-compute[73627]:   <features>
Aug 26 16:47:39 user nova-compute[73627]:     <acpi/>
Aug 26 16:47:39 user nova-compute[73627]:     <apic/>
Aug 26 16:47:39 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:47:39 user nova-compute[73627]:   </features>
Aug 26 16:47:39 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:47:39 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:47:39 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:47:39 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:47:39 user nova-compute[73627]:   </clock>
Aug 26 16:47:39 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:47:39 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:47:39 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:47:39 user nova-compute[73627]:   </cpu>
Aug 26 16:47:39 user nova-compute[73627]:   <devices>
Aug 26 16:47:39 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:47:39 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:47:39 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk"/>
Aug 26 16:47:39 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:47:39 user nova-compute[73627]:     </disk>
Aug 26 16:47:39 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:47:39 user nova-compute[73627]:       <mac address="fa:16:3e:2d:b5:db"/>
Aug 26 16:47:39 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:47:39 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:47:39 user nova-compute[73627]:       <target dev="tapc714f5c2-5c"/>
Aug 26 16:47:39 user nova-compute[73627]:     </interface>
Aug 26 16:47:39 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:47:39 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/console.log" append="off"/>
Aug 26 16:47:39 user nova-compute[73627]:     </serial>
Aug 26 16:47:39 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:47:39 user nova-compute[73627]:     <video>
Aug 26 16:47:39 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:47:39 user nova-compute[73627]:     </video>
Aug 26 16:47:39 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:47:39 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:47:39 user nova-compute[73627]:     </rng>
Aug 26 16:47:39 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:47:39 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:47:39 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:47:39 user nova-compute[73627]:     </memballoon>
Aug 26 16:47:39 user nova-compute[73627]:   </devices>
Aug 26 16:47:39 user nova-compute[73627]: </domain>
Aug 26 16:47:39 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:47:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2061154556',display_name='tempest-VolumesSnapshotTestJSON-instance-2061154556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2061154556',id=42,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgB359csoIAZ/lCAE/y1YujQtoF+PoW2X36uyo8ss0EBB/Kfyl2Ne+B4kal964hjEVfRw4opSYqUM1gRKwya3fsbQWsw3C/M1mPX3lrHvaSAe3jgk4PZtkiNkJtpu2yvw==',key_name='tempest-keypair-1975616310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1550b44802843dca4d2f8ad38adbc12',ramdisk_id='',reservation_id='r-wnzyiox0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-351265767',owner_user_name='tempest-VolumesSnapshotTestJSON-351265767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3725a470efe84258825ac4db497f6761',uuid=4ea0a009-4457-42f6-9c36-7b2325b73071,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converting VIF {"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b5:db,bridge_name='br-int',has_traffic_filtering=True,id=c714f5c2-5c80-432c-a360-b689eead7360,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc714f5c2-5c') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG os_vif [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b5:db,bridge_name='br-int',has_traffic_filtering=True,id=c714f5c2-5c80-432c-a360-b689eead7360,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc714f5c2-5c') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc714f5c2-5c, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc714f5c2-5c, col_values=(('external_ids', {'iface-id': 'c714f5c2-5c80-432c-a360-b689eead7360', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:b5:db', 'vm-uuid': '4ea0a009-4457-42f6-9c36-7b2325b73071'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:39 user nova-compute[73627]: INFO os_vif [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b5:db,bridge_name='br-int',has_traffic_filtering=True,id=c714f5c2-5c80-432c-a360-b689eead7360,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc714f5c2-5c')
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] No VIF found with MAC fa:16:3e:2d:b5:db, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.network.neutron [req-13a596f1-a851-4054-bf93-a5b005ddf8c7 req-5b7ca0e4-9d46-42dd-8dfb-d4afc481b4db service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Updated VIF entry in instance network info cache for port c714f5c2-5c80-432c-a360-b689eead7360. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG nova.network.neutron [req-13a596f1-a851-4054-bf93-a5b005ddf8c7 req-5b7ca0e4-9d46-42dd-8dfb-d4afc481b4db service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Updating instance_info_cache with network_info: [{"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:47:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-13a596f1-a851-4054-bf93-a5b005ddf8c7 req-5b7ca0e4-9d46-42dd-8dfb-d4afc481b4db service nova] Releasing lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:47:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-6567f886-a2d8-49d4-8e7d-94b6df27a78d req-567eb612-667f-49ff-a16c-d712a9928274 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:47:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6567f886-a2d8-49d4-8e7d-94b6df27a78d req-567eb612-667f-49ff-a16c-d712a9928274 service nova] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6567f886-a2d8-49d4-8e7d-94b6df27a78d req-567eb612-667f-49ff-a16c-d712a9928274 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6567f886-a2d8-49d4-8e7d-94b6df27a78d req-567eb612-667f-49ff-a16c-d712a9928274 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-6567f886-a2d8-49d4-8e7d-94b6df27a78d req-567eb612-667f-49ff-a16c-d712a9928274 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] No waiting events found dispatching network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:47:41 user nova-compute[73627]: WARNING nova.compute.manager [req-6567f886-a2d8-49d4-8e7d-94b6df27a78d req-567eb612-667f-49ff-a16c-d712a9928274 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received unexpected event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 for instance with vm_state building and task_state spawning.
Aug 26 16:47:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-152a4e31-d12c-4e7d-b7b2-c1d92d71ff32 req-f7f05922-5957-4ef5-a8da-89d2ed9e6dbb service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-152a4e31-d12c-4e7d-b7b2-c1d92d71ff32 req-f7f05922-5957-4ef5-a8da-89d2ed9e6dbb service nova] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-152a4e31-d12c-4e7d-b7b2-c1d92d71ff32 req-f7f05922-5957-4ef5-a8da-89d2ed9e6dbb service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-152a4e31-d12c-4e7d-b7b2-c1d92d71ff32 req-f7f05922-5957-4ef5-a8da-89d2ed9e6dbb service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-152a4e31-d12c-4e7d-b7b2-c1d92d71ff32 req-f7f05922-5957-4ef5-a8da-89d2ed9e6dbb service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] No waiting events found dispatching network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:47:43 user nova-compute[73627]: WARNING nova.compute.manager [req-152a4e31-d12c-4e7d-b7b2-c1d92d71ff32 req-f7f05922-5957-4ef5-a8da-89d2ed9e6dbb service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received unexpected event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 for instance with vm_state building and task_state spawning.
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068463.1871865, 4ea0a009-4457-42f6-9c36-7b2325b73071 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:47:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] VM Resumed (Lifecycle Event)
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:47:43 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Instance spawned successfully.
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:47:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068463.1887515, 4ea0a009-4457-42f6-9c36-7b2325b73071 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:47:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] VM Started (Lifecycle Event)
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:47:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:47:43 user nova-compute[73627]: INFO nova.compute.manager [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 26 16:47:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:47:43 user nova-compute[73627]: INFO nova.compute.manager [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Took 6.81 seconds to build instance.
Aug 26 16:47:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e242f06c-c352-47a7-9af5-2786200b0772 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.935s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:47:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:47:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:47:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:47:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:47:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:47:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:47:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "c3901966-61e2-4be6-bb8f-bbc449c35b78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:04 user nova-compute[73627]: INFO nova.compute.manager [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Terminating instance
Aug 26 16:48:04 user nova-compute[73627]: DEBUG nova.compute.manager [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-de79e485-7a2f-4e91-ac55-9e0b5b08bbaf req-0158c637-f315-4732-8f52-ed624f9ebbf0 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-vif-unplugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-de79e485-7a2f-4e91-ac55-9e0b5b08bbaf req-0158c637-f315-4732-8f52-ed624f9ebbf0 service nova] Acquiring lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-de79e485-7a2f-4e91-ac55-9e0b5b08bbaf req-0158c637-f315-4732-8f52-ed624f9ebbf0 service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-de79e485-7a2f-4e91-ac55-9e0b5b08bbaf req-0158c637-f315-4732-8f52-ed624f9ebbf0 service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-de79e485-7a2f-4e91-ac55-9e0b5b08bbaf req-0158c637-f315-4732-8f52-ed624f9ebbf0 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] No waiting events found dispatching network-vif-unplugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-de79e485-7a2f-4e91-ac55-9e0b5b08bbaf req-0158c637-f315-4732-8f52-ed624f9ebbf0 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-vif-unplugged-9c451176-da07-49b3-8a14-03f62ec16298 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:04 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Instance destroyed successfully.
Aug 26 16:48:04 user nova-compute[73627]: DEBUG nova.objects.instance [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lazy-loading 'resources' on Instance uuid c3901966-61e2-4be6-bb8f-bbc449c35b78 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:29:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1925057988',display_name='tempest-ServerActionsTestOtherA-server-1925057988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1925057988',id=24,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPablajuq8xLBFiX0kjjyHTcUxoq8CZCKKmSQoF/n+RncsJGeKPTG3tFOgrEM0xDUb7dmLLfXVGvvH6d7PuXa2K1fYDVua5anrg1Gw7a6no9azLYSkiUBpYQ6yR/vuL6og==',key_name='tempest-keypair-1189535517',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:29:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f8aed25a3184cf884a5774515d6d202',ramdisk_id='',reservation_id='r-gf260oy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1664197223',owner_user_name='tempest-ServerActionsTestOtherA-1664197223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:29:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8945b1b1110e44568e0de86204d65e34',uuid=c3901966-61e2-4be6-bb8f-bbc449c35b78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converting VIF {"id": "9c451176-da07-49b3-8a14-03f62ec16298", "address": "fa:16:3e:a1:e2:5d", "network": {"id": "bd2b493a-7e10-4e22-91a6-9aa59da9e63e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1212226892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8aed25a3184cf884a5774515d6d202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c451176-da", "ovs_interfaceid": "9c451176-da07-49b3-8a14-03f62ec16298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=9c451176-da07-49b3-8a14-03f62ec16298,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c451176-da') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG os_vif [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=9c451176-da07-49b3-8a14-03f62ec16298,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c451176-da') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c451176-da, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:48:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:48:05 user nova-compute[73627]: INFO os_vif [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e2:5d,bridge_name='br-int',has_traffic_filtering=True,id=9c451176-da07-49b3-8a14-03f62ec16298,network=Network(bd2b493a-7e10-4e22-91a6-9aa59da9e63e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c451176-da')
Aug 26 16:48:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Deleting instance files /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78_del
Aug 26 16:48:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Deletion of /opt/stack/data/nova/instances/c3901966-61e2-4be6-bb8f-bbc449c35b78_del complete
Aug 26 16:48:05 user nova-compute[73627]: INFO nova.compute.manager [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 16:48:05 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:48:05 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:48:05 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:48:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:48:06 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Took 1.22 seconds to deallocate network for instance.
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:06 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Deleted allocations for instance c3901966-61e2-4be6-bb8f-bbc449c35b78
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Acquiring lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] No waiting events found dispatching network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:48:06 user nova-compute[73627]: WARNING nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received unexpected event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 for instance with vm_state deleted and task_state None.
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Acquiring lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] No waiting events found dispatching network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:48:06 user nova-compute[73627]: WARNING nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received unexpected event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 for instance with vm_state deleted and task_state None.
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Acquiring lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] No waiting events found dispatching network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:48:06 user nova-compute[73627]: WARNING nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received unexpected event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 for instance with vm_state deleted and task_state None.
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Acquiring lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] No waiting events found dispatching network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:48:06 user nova-compute[73627]: WARNING nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received unexpected event network-vif-plugged-9c451176-da07-49b3-8a14-03f62ec16298 for instance with vm_state deleted and task_state None.
Aug 26 16:48:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-7361d30f-fd60-43a2-8ce7-5719751694b7 req-f7010c4a-b160-475c-bddb-685e3197aae3 service nova] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Received event network-vif-deleted-9c451176-da07-49b3-8a14-03f62ec16298 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:48:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-53439242-aa77-49c6-ad38-4de2c0454ac6 tempest-ServerActionsTestOtherA-1664197223 tempest-ServerActionsTestOtherA-1664197223-project-member] Lock "c3901966-61e2-4be6-bb8f-bbc449c35b78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.651s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-603f9595-b24b-49a8-9e53-468665bb8b19 req-030e8392-14b2-4b6b-9a84-cbcc892e2783 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Received event network-changed-15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:48:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-603f9595-b24b-49a8-9e53-468665bb8b19 req-030e8392-14b2-4b6b-9a84-cbcc892e2783 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Refreshing instance network info cache due to event network-changed-15fa00c5-3dd3-491b-8b5b-07cbd181a381. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:48:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-603f9595-b24b-49a8-9e53-468665bb8b19 req-030e8392-14b2-4b6b-9a84-cbcc892e2783 service nova] Acquiring lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:48:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-603f9595-b24b-49a8-9e53-468665bb8b19 req-030e8392-14b2-4b6b-9a84-cbcc892e2783 service nova] Acquired lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:48:09 user nova-compute[73627]: DEBUG nova.network.neutron [req-603f9595-b24b-49a8-9e53-468665bb8b19 req-030e8392-14b2-4b6b-9a84-cbcc892e2783 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Refreshing network info cache for port 15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:48:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:10 user nova-compute[73627]: DEBUG nova.network.neutron [req-603f9595-b24b-49a8-9e53-468665bb8b19 req-030e8392-14b2-4b6b-9a84-cbcc892e2783 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Updated VIF entry in instance network info cache for port 15fa00c5-3dd3-491b-8b5b-07cbd181a381. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:48:10 user nova-compute[73627]: DEBUG nova.network.neutron [req-603f9595-b24b-49a8-9e53-468665bb8b19 req-030e8392-14b2-4b6b-9a84-cbcc892e2783 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Updating instance_info_cache with network_info: [{"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:48:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-603f9595-b24b-49a8-9e53-468665bb8b19 req-030e8392-14b2-4b6b-9a84-cbcc892e2783 service nova] Releasing lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:48:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:18 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:48:19 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:48:19 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068484.9289756, c3901966-61e2-4be6-bb8f-bbc449c35b78 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:48:19 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] VM Stopped (Lifecycle Event)
Aug 26 16:48:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-937b6d4d-c7e1-441a-a727-5286f0de1d6a None None] [instance: c3901966-61e2-4be6-bb8f-bbc449c35b78] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:48:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:21 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:48:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:48:23 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:48:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:48:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:48:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:48:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:48:23 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:48:23 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid 2ffdcd8b-ac91-4686-82a6-79da99ddb253 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:48:24 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Updating instance_info_cache with network_info: [{"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:48:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-2ffdcd8b-ac91-4686-82a6-79da99ddb253" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:48:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:48:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:48:25 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:48:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:48:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:27 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:48:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:48:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:48:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:48:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:48:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:48:29 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:48:29 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:48:29 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8309MB free_disk=25.315948486328125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:48:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:29 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 2ffdcd8b-ac91-4686-82a6-79da99ddb253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:48:29 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:48:29 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 4ea0a009-4457-42f6-9c36-7b2325b73071 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:48:29 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:48:29 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:48:29 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:48:29 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:48:29 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:48:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:30 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:48:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:48:30 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:48:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:48:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:32 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:48:32 user nova-compute[73627]: INFO nova.compute.claims [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Claim successful on node user
Aug 26 16:48:33 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:48:33 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:48:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:48:33 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:48:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:48:33 user nova-compute[73627]: DEBUG nova.network.neutron [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:48:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:48:33 user nova-compute[73627]: INFO nova.virt.block_device [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Booting with volume snapshot ba902685-63fc-42db-a86a-345dae32a4c0 at /dev/vda
Aug 26 16:48:33 user nova-compute[73627]: DEBUG nova.policy [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c2828f3769d420b9d9caef2e6bc902f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4241157d52c848d49bed0589c2ec725e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:48:34 user nova-compute[73627]: DEBUG nova.network.neutron [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Successfully created port: d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Successfully updated port: d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "refresh_cache-15f8eb12-dbeb-4ebf-9e05-f827bd49f318" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquired lock "refresh_cache-15f8eb12-dbeb-4ebf-9e05-f827bd49f318" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG nova.compute.manager [req-6b9c6dd3-8555-472e-9379-ea050d51ddce req-3daf34f4-f7eb-43ce-a1e4-886bfcb6b97b service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-changed-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG nova.compute.manager [req-6b9c6dd3-8555-472e-9379-ea050d51ddce req-3daf34f4-f7eb-43ce-a1e4-886bfcb6b97b service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Refreshing instance network info cache due to event network-changed-d1ea0f7f-4d12-48a5-8475-225d76240606. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6b9c6dd3-8555-472e-9379-ea050d51ddce req-3daf34f4-f7eb-43ce-a1e4-886bfcb6b97b service nova] Acquiring lock "refresh_cache-15f8eb12-dbeb-4ebf-9e05-f827bd49f318" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Updating instance_info_cache with network_info: [{"id": "d1ea0f7f-4d12-48a5-8475-225d76240606", "address": "fa:16:3e:f8:65:86", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1ea0f7f-4d", "ovs_interfaceid": "d1ea0f7f-4d12-48a5-8475-225d76240606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Releasing lock "refresh_cache-15f8eb12-dbeb-4ebf-9e05-f827bd49f318" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Instance network_info: |[{"id": "d1ea0f7f-4d12-48a5-8475-225d76240606", "address": "fa:16:3e:f8:65:86", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1ea0f7f-4d", "ovs_interfaceid": "d1ea0f7f-4d12-48a5-8475-225d76240606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6b9c6dd3-8555-472e-9379-ea050d51ddce req-3daf34f4-f7eb-43ce-a1e4-886bfcb6b97b service nova] Acquired lock "refresh_cache-15f8eb12-dbeb-4ebf-9e05-f827bd49f318" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:48:35 user nova-compute[73627]: DEBUG nova.network.neutron [req-6b9c6dd3-8555-472e-9379-ea050d51ddce req-3daf34f4-f7eb-43ce-a1e4-886bfcb6b97b service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Refreshing network info cache for port d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:48:36 user nova-compute[73627]: DEBUG nova.network.neutron [req-6b9c6dd3-8555-472e-9379-ea050d51ddce req-3daf34f4-f7eb-43ce-a1e4-886bfcb6b97b service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Updated VIF entry in instance network info cache for port d1ea0f7f-4d12-48a5-8475-225d76240606. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:48:36 user nova-compute[73627]: DEBUG nova.network.neutron [req-6b9c6dd3-8555-472e-9379-ea050d51ddce req-3daf34f4-f7eb-43ce-a1e4-886bfcb6b97b service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Updating instance_info_cache with network_info: [{"id": "d1ea0f7f-4d12-48a5-8475-225d76240606", "address": "fa:16:3e:f8:65:86", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1ea0f7f-4d", "ovs_interfaceid": "d1ea0f7f-4d12-48a5-8475-225d76240606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:48:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6b9c6dd3-8555-472e-9379-ea050d51ddce req-3daf34f4-f7eb-43ce-a1e4-886bfcb6b97b service nova] Releasing lock "refresh_cache-15f8eb12-dbeb-4ebf-9e05-f827bd49f318" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:48:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:48:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:48:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:48:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:48:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG os_brick.utils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e6ee82-4707-4070-94f2-d43c2d047061]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[401237ff-fb04-4034-9311-30b8c5025c3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.081s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b344103-701b-46a5-9e7b-db1b591197dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54b95be-e4fb-4986-91df-0a8d0a4147f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:48:49 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:48:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[726b3eaf-130d-44cb-9d72-4a1ded8e5050]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG os_brick.utils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== get_connector_properties: return (215ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:48:49 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Updating existing volume attachment record: 26d4d2a3-2256-4dcb-98ed-7e56646b24af {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-a7ccec5b-9523-43ca-9714-b3dc2b62b999 req-ba4e7f70-84c8-4cb2-a0b1-a5e214d45763 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received event network-changed-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-a7ccec5b-9523-43ca-9714-b3dc2b62b999 req-ba4e7f70-84c8-4cb2-a0b1-a5e214d45763 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Refreshing instance network info cache due to event network-changed-47640bf5-754e-4f01-90a7-740813e8498e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7ccec5b-9523-43ca-9714-b3dc2b62b999 req-ba4e7f70-84c8-4cb2-a0b1-a5e214d45763 service nova] Acquiring lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7ccec5b-9523-43ca-9714-b3dc2b62b999 req-ba4e7f70-84c8-4cb2-a0b1-a5e214d45763 service nova] Acquired lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG nova.network.neutron [req-a7ccec5b-9523-43ca-9714-b3dc2b62b999 req-ba4e7f70-84c8-4cb2-a0b1-a5e214d45763 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Refreshing network info cache for port 47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG nova.network.neutron [req-a7ccec5b-9523-43ca-9714-b3dc2b62b999 req-ba4e7f70-84c8-4cb2-a0b1-a5e214d45763 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updated VIF entry in instance network info cache for port 47640bf5-754e-4f01-90a7-740813e8498e. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG nova.network.neutron [req-a7ccec5b-9523-43ca-9714-b3dc2b62b999 req-ba4e7f70-84c8-4cb2-a0b1-a5e214d45763 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updating instance_info_cache with network_info: [{"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lazy-loading 'flavor' on Instance uuid faa17ff2-089a-4499-bde5-3b9314b3c4a7 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7ccec5b-9523-43ca-9714-b3dc2b62b999 req-ba4e7f70-84c8-4cb2-a0b1-a5e214d45763 service nova] Releasing lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:48:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:48:50 user nova-compute[73627]: INFO nova.compute.manager [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Attaching volume 4202e7d0-7876-4818-b839-c71ae5ac5a19 to /dev/vdb
Aug 26 16:48:51 user nova-compute[73627]: DEBUG os_brick.utils [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e59d4d5-8966-4dad-ade6-ef8b0165dba9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1d8cc3-c3dc-45b6-964e-94fa62a1a233]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[553f5d44-bf5f-4047-9bdb-101c8d9decf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e44314c-7855-436a-be31-365a51a989ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:48:51 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:48:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f18d47f-1dbc-490d-909d-0daf84e5f6a1]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG os_brick.utils [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:48:51 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updating existing volume attachment record: e11cabf9-a0fc-4dbb-a4bc-5c5227becf49 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:48:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:48:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:49:01 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Creating image(s)
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Ensure instance console log exists: /opt/stack/data/nova/instances/15f8eb12-dbeb-4ebf-9e05-f827bd49f318/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Start _get_guest_xml network_info=[{"id": "d1ea0f7f-4d12-48a5-8475-225d76240606", "address": "fa:16:3e:f8:65:86", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1ea0f7f-4d", "ovs_interfaceid": "d1ea0f7f-4d12-48a5-8475-225d76240606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T16:48:11Z,direct_url=<?>,disk_format='qcow2',id=d8ac31fd-d6f9-4590-b080-e36cda88dfbb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1523992878',owner='4241157d52c848d49bed0589c2ec725e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T16:48:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEusRUOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15f8eb12-dbeb-4ebf-9e05-f827bd49f318', 'attached_at': '', 'detached_at': '', 'volume_id': 'edeeb009-a9e7-479a-a06b-2eafad4811b1', 'serial': 'edeeb009-a9e7-479a-a06b-2eafad4811b1'}, 'guest_format': None, 'attachment_id': '26d4d2a3-2256-4dcb-98ed-7e56646b24af', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:49:01 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:49:01 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T16:48:11Z,direct_url=<?>,disk_format='qcow2',id=d8ac31fd-d6f9-4590-b080-e36cda88dfbb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1523992878',owner='4241157d52c848d49bed0589c2ec725e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T16:48:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEusRUOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:49:01 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:49:01 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:49:01 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:49:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5a9d63-3e3d-4c4b-98ef-2c7f4b715beb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:49:01 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[682bb8c5-20f9-4c6b-9c14-7f1517a17ac1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1] added
Aug 26 16:49:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37d91a1-f8b9-491a-b6ce-25c47520c2d7]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1df964-3857-4395-93a6-7cbd48be7340]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEusRUOP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEusRUOP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb60a0-5246-4421-ae03-fce99277948d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VEusRUOP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d4f728-0303-4755-864a-cf7efafc0dfd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[855a9814-18a5-4aaf-a63e-5b4ce020d665]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[969a5f9e-32ad-4505-b453-f65b9ef65cdb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1, portal: 172.16.0.220,3260]
Aug 26 16:49:01 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1, portal: 172.16.0.220,3260] successful.
Aug 26 16:49:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a032bcf9-d2ff-48d7-93c5-eeb0d587a23e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a22f2e-f066-48c6-b339-76f5d2cedd1e]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:01 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:01 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:01 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcde9d3a-2a46-488d-855c-16882ec704f6]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:49:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEusRUOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23962396261613031', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962396261613031', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:48:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-484602158',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-484602158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-484602158',id=43,image_ref='d8ac31fd-d6f9-4590-b080-e36cda88dfbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwgV+YNG5/keeWXMZbr4Vi+RhCV6vj3SUthwWdM9RXs2vxaQChYFZxdV2lHPtOrBKIO9xVEjAq2HHok9CO74E2HX9hqgVw6jlqyGiMWdozVVqYlFi1hzLBK+1XdaQNcIw==',key_name='tempest-keypair-1734562285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-y9euhvwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1705344746',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:48:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=15f8eb12-dbeb-4ebf-9e05-f827bd49f318,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1ea0f7f-4d12-48a5-8475-225d76240606", "address": "fa:16:3e:f8:65:86", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1ea0f7f-4d", "ovs_interfaceid": "d1ea0f7f-4d12-48a5-8475-225d76240606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "d1ea0f7f-4d12-48a5-8475-225d76240606", "address": "fa:16:3e:f8:65:86", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1ea0f7f-4d", "ovs_interfaceid": "d1ea0f7f-4d12-48a5-8475-225d76240606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:65:86,bridge_name='br-int',has_traffic_filtering=True,id=d1ea0f7f-4d12-48a5-8475-225d76240606,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1ea0f7f-4d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG nova.objects.instance [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'pci_devices' on Instance uuid 15f8eb12-dbeb-4ebf-9e05-f827bd49f318 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:49:02 user nova-compute[73627]:   <uuid>15f8eb12-dbeb-4ebf-9e05-f827bd49f318</uuid>
Aug 26 16:49:02 user nova-compute[73627]:   <name>instance-0000002b</name>
Aug 26 16:49:02 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:49:02 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:49:02 user nova-compute[73627]:   <metadata>
Aug 26 16:49:02 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:49:02 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:49:02 user nova-compute[73627]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-484602158</nova:name>
Aug 26 16:49:02 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:49:01</nova:creationTime>
Aug 26 16:49:02 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:49:02 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:49:02 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:49:02 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:49:02 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:49:02 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:49:02 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:49:02 user nova-compute[73627]:       <nova:owner>
Aug 26 16:49:02 user nova-compute[73627]:         <nova:user uuid="1c2828f3769d420b9d9caef2e6bc902f">tempest-TestVolumeBootPattern-1705344746-project-member</nova:user>
Aug 26 16:49:02 user nova-compute[73627]:         <nova:project uuid="4241157d52c848d49bed0589c2ec725e">tempest-TestVolumeBootPattern-1705344746</nova:project>
Aug 26 16:49:02 user nova-compute[73627]:       </nova:owner>
Aug 26 16:49:02 user nova-compute[73627]:       <nova:root type="image" uuid="d8ac31fd-d6f9-4590-b080-e36cda88dfbb"/>
Aug 26 16:49:02 user nova-compute[73627]:       <nova:ports>
Aug 26 16:49:02 user nova-compute[73627]:         <nova:port uuid="d1ea0f7f-4d12-48a5-8475-225d76240606">
Aug 26 16:49:02 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 16:49:02 user nova-compute[73627]:         </nova:port>
Aug 26 16:49:02 user nova-compute[73627]:       </nova:ports>
Aug 26 16:49:02 user nova-compute[73627]:     </nova:instance>
Aug 26 16:49:02 user nova-compute[73627]:   </metadata>
Aug 26 16:49:02 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:49:02 user nova-compute[73627]:     <system>
Aug 26 16:49:02 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:49:02 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:49:02 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:49:02 user nova-compute[73627]:       <entry name="serial">15f8eb12-dbeb-4ebf-9e05-f827bd49f318</entry>
Aug 26 16:49:02 user nova-compute[73627]:       <entry name="uuid">15f8eb12-dbeb-4ebf-9e05-f827bd49f318</entry>
Aug 26 16:49:02 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:49:02 user nova-compute[73627]:     </system>
Aug 26 16:49:02 user nova-compute[73627]:   </sysinfo>
Aug 26 16:49:02 user nova-compute[73627]:   <os>
Aug 26 16:49:02 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:49:02 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:49:02 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:49:02 user nova-compute[73627]:   </os>
Aug 26 16:49:02 user nova-compute[73627]:   <features>
Aug 26 16:49:02 user nova-compute[73627]:     <acpi/>
Aug 26 16:49:02 user nova-compute[73627]:     <apic/>
Aug 26 16:49:02 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:49:02 user nova-compute[73627]:   </features>
Aug 26 16:49:02 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:49:02 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:49:02 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:49:02 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:49:02 user nova-compute[73627]:   </clock>
Aug 26 16:49:02 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:49:02 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:49:02 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:49:02 user nova-compute[73627]:   </cpu>
Aug 26 16:49:02 user nova-compute[73627]:   <devices>
Aug 26 16:49:02 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:49:02 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:49:02 user nova-compute[73627]:       <source dev="/dev/sdb"/>
Aug 26 16:49:02 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:49:02 user nova-compute[73627]:       <serial>edeeb009-a9e7-479a-a06b-2eafad4811b1</serial>
Aug 26 16:49:02 user nova-compute[73627]:     </disk>
Aug 26 16:49:02 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:49:02 user nova-compute[73627]:       <mac address="fa:16:3e:f8:65:86"/>
Aug 26 16:49:02 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:49:02 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:49:02 user nova-compute[73627]:       <target dev="tapd1ea0f7f-4d"/>
Aug 26 16:49:02 user nova-compute[73627]:     </interface>
Aug 26 16:49:02 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:49:02 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/15f8eb12-dbeb-4ebf-9e05-f827bd49f318/console.log" append="off"/>
Aug 26 16:49:02 user nova-compute[73627]:     </serial>
Aug 26 16:49:02 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:49:02 user nova-compute[73627]:     <video>
Aug 26 16:49:02 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:49:02 user nova-compute[73627]:     </video>
Aug 26 16:49:02 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:49:02 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:49:02 user nova-compute[73627]:     </rng>
Aug 26 16:49:02 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:49:02 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:49:02 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:49:02 user nova-compute[73627]:     </memballoon>
Aug 26 16:49:02 user nova-compute[73627]:   </devices>
Aug 26 16:49:02 user nova-compute[73627]: </domain>
Aug 26 16:49:02 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:48:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-484602158',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-484602158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-484602158',id=43,image_ref='d8ac31fd-d6f9-4590-b080-e36cda88dfbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwgV+YNG5/keeWXMZbr4Vi+RhCV6vj3SUthwWdM9RXs2vxaQChYFZxdV2lHPtOrBKIO9xVEjAq2HHok9CO74E2HX9hqgVw6jlqyGiMWdozVVqYlFi1hzLBK+1XdaQNcIw==',key_name='tempest-keypair-1734562285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-y9euhvwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1705344746',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:48:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=15f8eb12-dbeb-4ebf-9e05-f827bd49f318,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1ea0f7f-4d12-48a5-8475-225d76240606", "address": "fa:16:3e:f8:65:86", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1ea0f7f-4d", "ovs_interfaceid": "d1ea0f7f-4d12-48a5-8475-225d76240606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "d1ea0f7f-4d12-48a5-8475-225d76240606", "address": "fa:16:3e:f8:65:86", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1ea0f7f-4d", "ovs_interfaceid": "d1ea0f7f-4d12-48a5-8475-225d76240606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:65:86,bridge_name='br-int',has_traffic_filtering=True,id=d1ea0f7f-4d12-48a5-8475-225d76240606,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1ea0f7f-4d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG os_vif [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:65:86,bridge_name='br-int',has_traffic_filtering=True,id=d1ea0f7f-4d12-48a5-8475-225d76240606,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1ea0f7f-4d') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1ea0f7f-4d, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1ea0f7f-4d, col_values=(('external_ids', {'iface-id': 'd1ea0f7f-4d12-48a5-8475-225d76240606', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:65:86', 'vm-uuid': '15f8eb12-dbeb-4ebf-9e05-f827bd49f318'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:02 user nova-compute[73627]: INFO os_vif [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:65:86,bridge_name='br-int',has_traffic_filtering=True,id=d1ea0f7f-4d12-48a5-8475-225d76240606,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1ea0f7f-4d')
Aug 26 16:49:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:49:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No VIF found with MAC fa:16:3e:f8:65:86, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:49:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-16f34472-5663-4f9b-98cd-461ddee38d17 req-f698b6bc-30e7-436c-830a-c5de2c58f479 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:49:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-16f34472-5663-4f9b-98cd-461ddee38d17 req-f698b6bc-30e7-436c-830a-c5de2c58f479 service nova] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-16f34472-5663-4f9b-98cd-461ddee38d17 req-f698b6bc-30e7-436c-830a-c5de2c58f479 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-16f34472-5663-4f9b-98cd-461ddee38d17 req-f698b6bc-30e7-436c-830a-c5de2c58f479 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-16f34472-5663-4f9b-98cd-461ddee38d17 req-f698b6bc-30e7-436c-830a-c5de2c58f479 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] No waiting events found dispatching network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:49:04 user nova-compute[73627]: WARNING nova.compute.manager [req-16f34472-5663-4f9b-98cd-461ddee38d17 req-f698b6bc-30e7-436c-830a-c5de2c58f479 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received unexpected event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 for instance with vm_state building and task_state spawning.
Aug 26 16:49:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-e05b33bc-aee7-4377-aa7f-98005d80cb62 req-1a709bf5-a17d-4a7d-818b-5b6495769abe service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e05b33bc-aee7-4377-aa7f-98005d80cb62 req-1a709bf5-a17d-4a7d-818b-5b6495769abe service nova] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e05b33bc-aee7-4377-aa7f-98005d80cb62 req-1a709bf5-a17d-4a7d-818b-5b6495769abe service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e05b33bc-aee7-4377-aa7f-98005d80cb62 req-1a709bf5-a17d-4a7d-818b-5b6495769abe service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.compute.manager [req-e05b33bc-aee7-4377-aa7f-98005d80cb62 req-1a709bf5-a17d-4a7d-818b-5b6495769abe service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] No waiting events found dispatching network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:49:06 user nova-compute[73627]: WARNING nova.compute.manager [req-e05b33bc-aee7-4377-aa7f-98005d80cb62 req-1a709bf5-a17d-4a7d-818b-5b6495769abe service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received unexpected event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 for instance with vm_state building and task_state spawning.
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068546.748745, 15f8eb12-dbeb-4ebf-9e05-f827bd49f318 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:49:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] VM Resumed (Lifecycle Event)
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:49:06 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Instance spawned successfully.
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:49:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068546.750647, 15f8eb12-dbeb-4ebf-9e05-f827bd49f318 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:49:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] VM Started (Lifecycle Event)
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:49:06 user nova-compute[73627]: INFO nova.compute.manager [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 26 16:49:06 user nova-compute[73627]: DEBUG nova.compute.manager [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:49:06 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:49:06 user nova-compute[73627]: INFO nova.compute.manager [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Took 34.16 seconds to build instance.
Aug 26 16:49:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-945e4309-6c2f-4c86-8a8a-a9956fe6ed34 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.266s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "228134a5-86c8-47bc-a34d-e0aba6b33e08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:49:10 user nova-compute[73627]: INFO nova.compute.claims [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Claim successful on node user
Aug 26 16:49:10 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:49:10 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:49:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG nova.policy [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a771feb2513a4866a1209f1abf754e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddffe7ec6b14545bd7f8d741be7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:49:10 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Creating image(s)
Aug 26 16:49:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "/opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "/opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "/opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.208s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk 1073741824" returned: 0 in 0.067s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Successfully created port: d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.193s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Checking if we can resize image /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Cannot resize image /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Ensure instance console log exists: /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Successfully updated port: d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquired lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-450ef36b-f75f-4e3d-8c90-afdf3b548bf2 req-d1b88b10-dd38-4860-bb94-81034a355fca service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Received event network-changed-d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-450ef36b-f75f-4e3d-8c90-afdf3b548bf2 req-d1b88b10-dd38-4860-bb94-81034a355fca service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Refreshing instance network info cache due to event network-changed-d9444d43-8990-4389-a11c-2fdecd6a1644. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-450ef36b-f75f-4e3d-8c90-afdf3b548bf2 req-d1b88b10-dd38-4860-bb94-81034a355fca service nova] Acquiring lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Updating instance_info_cache with network_info: [{"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Releasing lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Instance network_info: |[{"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-450ef36b-f75f-4e3d-8c90-afdf3b548bf2 req-d1b88b10-dd38-4860-bb94-81034a355fca service nova] Acquired lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-450ef36b-f75f-4e3d-8c90-afdf3b548bf2 req-d1b88b10-dd38-4860-bb94-81034a355fca service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Refreshing network info cache for port d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Start _get_guest_xml network_info=[{"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:49:12 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:49:12 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:49:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1640169064',display_name='tempest-ServersNegativeTestJSON-server-1640169064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1640169064',id=44,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ddffe7ec6b14545bd7f8d741be7c4a2',ramdisk_id='',reservation_id='r-huirv66y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2065687253',owner_user_name='tempest-ServersNegativeTestJSON-2065687253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:49:11Z,user_data=None,user_id='a771feb2513a4866a1209f1abf754e8c',uuid=228134a5-86c8-47bc-a34d-e0aba6b33e08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converting VIF {"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:0c,bridge_name='br-int',has_traffic_filtering=True,id=d9444d43-8990-4389-a11c-2fdecd6a1644,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9444d43-89') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lazy-loading 'pci_devices' on Instance uuid 228134a5-86c8-47bc-a34d-e0aba6b33e08 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwrmNMgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:49:12 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:49:12 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:49:12 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:49:12 user nova-compute[73627]:   <uuid>228134a5-86c8-47bc-a34d-e0aba6b33e08</uuid>
Aug 26 16:49:12 user nova-compute[73627]:   <name>instance-0000002c</name>
Aug 26 16:49:12 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:49:12 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:49:12 user nova-compute[73627]:   <metadata>
Aug 26 16:49:12 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:49:12 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:49:12 user nova-compute[73627]:       <nova:name>tempest-ServersNegativeTestJSON-server-1640169064</nova:name>
Aug 26 16:49:12 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:49:12</nova:creationTime>
Aug 26 16:49:12 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:49:12 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:49:12 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:49:12 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:49:12 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:49:12 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:49:12 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:49:12 user nova-compute[73627]:       <nova:owner>
Aug 26 16:49:12 user nova-compute[73627]:         <nova:user uuid="a771feb2513a4866a1209f1abf754e8c">tempest-ServersNegativeTestJSON-2065687253-project-member</nova:user>
Aug 26 16:49:12 user nova-compute[73627]:         <nova:project uuid="6ddffe7ec6b14545bd7f8d741be7c4a2">tempest-ServersNegativeTestJSON-2065687253</nova:project>
Aug 26 16:49:12 user nova-compute[73627]:       </nova:owner>
Aug 26 16:49:12 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:49:12 user nova-compute[73627]:       <nova:ports>
Aug 26 16:49:12 user nova-compute[73627]:         <nova:port uuid="d9444d43-8990-4389-a11c-2fdecd6a1644">
Aug 26 16:49:12 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 16:49:12 user nova-compute[73627]:         </nova:port>
Aug 26 16:49:12 user nova-compute[73627]:       </nova:ports>
Aug 26 16:49:12 user nova-compute[73627]:     </nova:instance>
Aug 26 16:49:12 user nova-compute[73627]:   </metadata>
Aug 26 16:49:12 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:49:12 user nova-compute[73627]:     <system>
Aug 26 16:49:12 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:49:12 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:49:12 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:49:12 user nova-compute[73627]:       <entry name="serial">228134a5-86c8-47bc-a34d-e0aba6b33e08</entry>
Aug 26 16:49:12 user nova-compute[73627]:       <entry name="uuid">228134a5-86c8-47bc-a34d-e0aba6b33e08</entry>
Aug 26 16:49:12 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:49:12 user nova-compute[73627]:     </system>
Aug 26 16:49:12 user nova-compute[73627]:   </sysinfo>
Aug 26 16:49:12 user nova-compute[73627]:   <os>
Aug 26 16:49:12 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:49:12 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:49:12 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:49:12 user nova-compute[73627]:   </os>
Aug 26 16:49:12 user nova-compute[73627]:   <features>
Aug 26 16:49:12 user nova-compute[73627]:     <acpi/>
Aug 26 16:49:12 user nova-compute[73627]:     <apic/>
Aug 26 16:49:12 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:49:12 user nova-compute[73627]:   </features>
Aug 26 16:49:12 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:49:12 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:49:12 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:49:12 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:49:12 user nova-compute[73627]:   </clock>
Aug 26 16:49:12 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:49:12 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:49:12 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:49:12 user nova-compute[73627]:   </cpu>
Aug 26 16:49:12 user nova-compute[73627]:   <devices>
Aug 26 16:49:12 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:49:12 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:49:12 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk"/>
Aug 26 16:49:12 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:49:12 user nova-compute[73627]:     </disk>
Aug 26 16:49:12 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:49:12 user nova-compute[73627]:       <mac address="fa:16:3e:11:4a:0c"/>
Aug 26 16:49:12 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:49:12 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:49:12 user nova-compute[73627]:       <target dev="tapd9444d43-89"/>
Aug 26 16:49:12 user nova-compute[73627]:     </interface>
Aug 26 16:49:12 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:49:12 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/console.log" append="off"/>
Aug 26 16:49:12 user nova-compute[73627]:     </serial>
Aug 26 16:49:12 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:49:12 user nova-compute[73627]:     <video>
Aug 26 16:49:12 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:49:12 user nova-compute[73627]:     </video>
Aug 26 16:49:12 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:49:12 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:49:12 user nova-compute[73627]:     </rng>
Aug 26 16:49:12 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:49:12 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:49:12 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:49:12 user nova-compute[73627]:     </memballoon>
Aug 26 16:49:12 user nova-compute[73627]:   </devices>
Aug 26 16:49:12 user nova-compute[73627]: </domain>
Aug 26 16:49:12 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1640169064',display_name='tempest-ServersNegativeTestJSON-server-1640169064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1640169064',id=44,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ddffe7ec6b14545bd7f8d741be7c4a2',ramdisk_id='',reservation_id='r-huirv66y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2065687253',owner_user_name='tempest-ServersNegativeTestJSON-2065687253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:49:11Z,user_data=None,user_id='a771feb2513a4866a1209f1abf754e8c',uuid=228134a5-86c8-47bc-a34d-e0aba6b33e08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converting VIF {"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:0c,bridge_name='br-int',has_traffic_filtering=True,id=d9444d43-8990-4389-a11c-2fdecd6a1644,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9444d43-89') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_vif [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:0c,bridge_name='br-int',has_traffic_filtering=True,id=d9444d43-8990-4389-a11c-2fdecd6a1644,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9444d43-89') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9444d43-89, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9444d43-89, col_values=(('external_ids', {'iface-id': 'd9444d43-8990-4389-a11c-2fdecd6a1644', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:4a:0c', 'vm-uuid': '228134a5-86c8-47bc-a34d-e0aba6b33e08'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[271519f7-0dc4-4e25-bd0d-a191a434d5e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:49:12 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:12 user nova-compute[73627]: INFO os_vif [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:0c,bridge_name='br-int',has_traffic_filtering=True,id=d9444d43-8990-4389-a11c-2fdecd6a1644,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9444d43-89')
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce56b68-787d-44f1-b078-4c31231d3496]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19] added
Aug 26 16:49:12 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcabe5a6-d1a8-478c-bcf6-b484edf6939b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a504e16b-402f-4ff6-b44f-8f79d29a3d35]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] No VIF found with MAC fa:16:3e:11:4a:0c, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cwrmNMgp {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cwrmNMgp" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d995ad90-dcad-4029-b745-9af2c53e9a73]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cwrmNMgp'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c21772-6767-4038-99d6-7da7a8af8725]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b89d38-9d33-447f-b19c-63baa39ec9bb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:13 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:13 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:13 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:13 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7499ab1-a35c-4fa2-8502-a67608c0800e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19, portal: 172.16.0.220,3260]
Aug 26 16:49:13 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19, portal: 172.16.0.220,3260] successful.
Aug 26 16:49:13 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07f4fa3-6443-48fb-9919-4075435a8d3c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b379b79e-55a7-4d62-bf00-ad636abddad1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:13 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:13 user nova-compute[73627]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 (non-flash)
Aug 26 16:49:13 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:13 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:13 user nova-compute[73627]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 (non-flash)
Aug 26 16:49:13 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ad079-aa8a-4d63-8b3a-fc09f3ed103e]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG nova.network.neutron [req-450ef36b-f75f-4e3d-8c90-afdf3b548bf2 req-d1b88b10-dd38-4860-bb94-81034a355fca service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Updated VIF entry in instance network info cache for port d9444d43-8990-4389-a11c-2fdecd6a1644. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG nova.network.neutron [req-450ef36b-f75f-4e3d-8c90-afdf3b548bf2 req-d1b88b10-dd38-4860-bb94-81034a355fca service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Updating instance_info_cache with network_info: [{"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:49:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-450ef36b-f75f-4e3d-8c90-afdf3b548bf2 req-d1b88b10-dd38-4860-bb94-81034a355fca service nova] Releasing lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwrmNMgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23639306432633331', 'path': '/dev/sdd'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639306432633331', 'path': '/dev/sdd'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lazy-loading 'flavor' on Instance uuid faa17ff2-089a-4499-bde5-3b9314b3c4a7 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:49:14 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:49:14 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:49:14 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:49:14 user nova-compute[73627]:   <serial>4202e7d0-7876-4818-b839-c71ae5ac5a19</serial>
Aug 26 16:49:14 user nova-compute[73627]: </disk>
Aug 26 16:49:14 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-666243a4-a7ba-4838-9c92-a3a1ff29dc7b req-87137dfb-610e-4d0d-957c-b72706076b8c service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Received event network-vif-plugged-d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-666243a4-a7ba-4838-9c92-a3a1ff29dc7b req-87137dfb-610e-4d0d-957c-b72706076b8c service nova] Acquiring lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-666243a4-a7ba-4838-9c92-a3a1ff29dc7b req-87137dfb-610e-4d0d-957c-b72706076b8c service nova] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-666243a4-a7ba-4838-9c92-a3a1ff29dc7b req-87137dfb-610e-4d0d-957c-b72706076b8c service nova] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-666243a4-a7ba-4838-9c92-a3a1ff29dc7b req-87137dfb-610e-4d0d-957c-b72706076b8c service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] No waiting events found dispatching network-vif-plugged-d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:49:14 user nova-compute[73627]: WARNING nova.compute.manager [req-666243a4-a7ba-4838-9c92-a3a1ff29dc7b req-87137dfb-610e-4d0d-957c-b72706076b8c service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Received unexpected event network-vif-plugged-d9444d43-8990-4389-a11c-2fdecd6a1644 for instance with vm_state building and task_state spawning.
Aug 26 16:49:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] No VIF found with MAC fa:16:3e:bb:46:cf, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c4b21b17-b806-4f12-a7e8-f355652069ee tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.863s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:15 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-e88fef1f-c8d6-430f-8ebb-a08e9b315d3c req-43195747-9857-4939-bf8f-e09f202e775e service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Received event network-vif-plugged-d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e88fef1f-c8d6-430f-8ebb-a08e9b315d3c req-43195747-9857-4939-bf8f-e09f202e775e service nova] Acquiring lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e88fef1f-c8d6-430f-8ebb-a08e9b315d3c req-43195747-9857-4939-bf8f-e09f202e775e service nova] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e88fef1f-c8d6-430f-8ebb-a08e9b315d3c req-43195747-9857-4939-bf8f-e09f202e775e service nova] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.compute.manager [req-e88fef1f-c8d6-430f-8ebb-a08e9b315d3c req-43195747-9857-4939-bf8f-e09f202e775e service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] No waiting events found dispatching network-vif-plugged-d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:49:16 user nova-compute[73627]: WARNING nova.compute.manager [req-e88fef1f-c8d6-430f-8ebb-a08e9b315d3c req-43195747-9857-4939-bf8f-e09f202e775e service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Received unexpected event network-vif-plugged-d9444d43-8990-4389-a11c-2fdecd6a1644 for instance with vm_state building and task_state spawning.
Aug 26 16:49:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:16 user nova-compute[73627]: INFO nova.compute.manager [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Detaching volume 4202e7d0-7876-4818-b839-c71ae5ac5a19
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068556.795947, 228134a5-86c8-47bc-a34d-e0aba6b33e08 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:49:16 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] VM Resumed (Lifecycle Event)
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:49:16 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Instance spawned successfully.
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:49:16 user nova-compute[73627]: INFO nova.virt.block_device [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Attempting to driver detach volume 4202e7d0-7876-4818-b839-c71ae5ac5a19 from mountpoint /dev/vdb
Aug 26 16:49:16 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068556.7966597, 228134a5-86c8-47bc-a34d-e0aba6b33e08 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:49:16 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] VM Started (Lifecycle Event)
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Attempting to detach device vdb from instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:49:16 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:49:16 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:49:16 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:49:16 user nova-compute[73627]:   <serial>4202e7d0-7876-4818-b839-c71ae5ac5a19</serial>
Aug 26 16:49:16 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:49:16 user nova-compute[73627]: </disk>
Aug 26 16:49:16 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:49:16 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Successfully detached device vdb from instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 from the persistent domain config.
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:49:16 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:49:16 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:49:16 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:49:16 user nova-compute[73627]:   <serial>4202e7d0-7876-4818-b839-c71ae5ac5a19</serial>
Aug 26 16:49:16 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:49:16 user nova-compute[73627]: </disk>
Aug 26 16:49:16 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:49:16 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:49:16 user nova-compute[73627]: INFO nova.compute.manager [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 26 16:49:16 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:49:17 user nova-compute[73627]: INFO nova.compute.manager [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Took 6.60 seconds to build instance.
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d6780b3-14ce-4846-a759-e4c8951d243d tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.726s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693068557.3257155, faa17ff2-089a-4499-bde5-3b9314b3c4a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:49:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Successfully detached device vdb from instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 from the live domain config.
Aug 26 16:49:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwrmNMgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:49:17 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5086f7e-7013-4541-8a57-926a02cd9922]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a07f798-29b9-4559-9632-4fad33ddebb3]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:17 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:17 user nova-compute[73627]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 (non-flash)
Aug 26 16:49:17 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:17 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:17 user nova-compute[73627]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 (non-flash)
Aug 26 16:49:17 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d03d4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19'): ({'sdd'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Removing single pathed devices sdd {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf2cffc-9578-4f2d-a9f7-8ba71a74f256]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffa95b5-7564-410d-b92c-c7532a94e392]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Flushing IO for device /dev/sdd {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[55321273-736b-497d-a92c-a3807603e179]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d59a25-fa9f-4961-9676-55f919ac5b76]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c35aaaf-c471-40c0-b31c-1aa45b0136d5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c421811-3aee-4c12-ac0f-e528c3594c55]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19, portal: 172.16.0.220,3260]
Aug 26 16:49:17 user nova-compute[73627]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19, portal: 172.16.0.220,3260] successful.
Aug 26 16:49:17 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202e7d0-7876-4818-b839-c71ae5ac5a19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbc52a2-3909-415c-9f35-82cdb5a7c4e5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] <== disconnect_volume: return (328ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:49:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:18 user nova-compute[73627]: DEBUG nova.objects.instance [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lazy-loading 'flavor' on Instance uuid faa17ff2-089a-4499-bde5-3b9314b3c4a7 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:49:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-cd99f762-ce30-4d0e-a154-2ab06bfd6d49 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.789s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:24 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:49:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:49:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:49:24 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:49:25 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updating instance_info_cache with network_info: [{"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:49:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:49:25 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:49:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:26 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-06b594df-2320-45ea-8e63-a1a009e48db1 req-557b3f15-c112-4aab-9252-19f19141e043 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-changed-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:49:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-06b594df-2320-45ea-8e63-a1a009e48db1 req-557b3f15-c112-4aab-9252-19f19141e043 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Refreshing instance network info cache due to event network-changed-c714f5c2-5c80-432c-a360-b689eead7360. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:49:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-06b594df-2320-45ea-8e63-a1a009e48db1 req-557b3f15-c112-4aab-9252-19f19141e043 service nova] Acquiring lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:49:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-06b594df-2320-45ea-8e63-a1a009e48db1 req-557b3f15-c112-4aab-9252-19f19141e043 service nova] Acquired lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:49:27 user nova-compute[73627]: DEBUG nova.network.neutron [req-06b594df-2320-45ea-8e63-a1a009e48db1 req-557b3f15-c112-4aab-9252-19f19141e043 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Refreshing network info cache for port c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:49:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:27 user nova-compute[73627]: DEBUG nova.objects.instance [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lazy-loading 'flavor' on Instance uuid 4ea0a009-4457-42f6-9c36-7b2325b73071 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:49:27 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Ignoring supplied device name: /dev/vdb
Aug 26 16:49:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:27 user nova-compute[73627]: INFO nova.compute.manager [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Attaching volume df7d09df-6a52-4c6a-80b4-682586d3719c to /dev/vdb
Aug 26 16:49:28 user nova-compute[73627]: DEBUG os_brick.utils [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[77025b3f-1a2b-4458-814a-a5702fda8b7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d823dea4-a57a-48b3-b13d-f4832bc3ff60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0d99c8-9e95-494b-baba-ef85a07ea1bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[645da554-10a9-4ab4-9a57-1a30d9cdadd3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:49:28 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[93566d87-93d3-4cc7-810d-b4c37712b71a]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG os_brick.utils [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Updating existing volume attachment record: 7934b882-ce94-4fc4-af95-373d5f4a52fd {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG nova.network.neutron [req-06b594df-2320-45ea-8e63-a1a009e48db1 req-557b3f15-c112-4aab-9252-19f19141e043 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Updated VIF entry in instance network info cache for port c714f5c2-5c80-432c-a360-b689eead7360. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG nova.network.neutron [req-06b594df-2320-45ea-8e63-a1a009e48db1 req-557b3f15-c112-4aab-9252-19f19141e043 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Updating instance_info_cache with network_info: [{"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-06b594df-2320-45ea-8e63-a1a009e48db1 req-557b3f15-c112-4aab-9252-19f19141e043 service nova] Releasing lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:49:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:49:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:49:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8174MB free_disk=25.302810668945312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 2ffdcd8b-ac91-4686-82a6-79da99ddb253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 4ea0a009-4457-42f6-9c36-7b2325b73071 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 15f8eb12-dbeb-4ebf-9e05-f827bd49f318 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 228134a5-86c8-47bc-a34d-e0aba6b33e08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing inventories for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating ProviderTree inventory for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating inventory in ProviderTree for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing aggregate associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, aggregates: None {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing trait associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:49:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:32 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:32 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:49:35 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:37 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 16:49:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] There are 0 instances to clean {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 16:49:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 2ffdcd8b-ac91-4686-82a6-79da99ddb253 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid faa17ff2-089a-4499-bde5-3b9314b3c4a7 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 4ea0a009-4457-42f6-9c36-7b2325b73071 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 15f8eb12-dbeb-4ebf-9e05-f827bd49f318 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 228134a5-86c8-47bc-a34d-e0aba6b33e08 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "228134a5-86c8-47bc-a34d-e0aba6b33e08" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGMJKnjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:49:39 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:49:39 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:49:39 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4a6381-f422-49a7-990f-bc04fa47902f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:49:39 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a824c2d-c55d-4390-9ae9-34da0e1890d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c] added
Aug 26 16:49:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e116ad-eae7-4793-9184-805318b602ca]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c025d756-b929-4484-b076-ddfded17fcba]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGMJKnjm {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGMJKnjm" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e13b3f-789c-4539-bd42-a5d58bb7e5c0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NGMJKnjm'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef723bf-3098-4f37-a0f1-bd0e5db0a7d2]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d19bcb-5477-46f4-a40a-c357b05b7956]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:39 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:39 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd45e165-e58f-4f66-9efb-d14f24a6c3d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c, portal: 172.16.0.220,3260]
Aug 26 16:49:39 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c, portal: 172.16.0.220,3260] successful.
Aug 26 16:49:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[714bfa57-a1cf-4d26-86d0-9acdddf8092e]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dc013f-510c-45e1-a5b8-a74d9fb47e99]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:39 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:39 user nova-compute[73627]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c (non-flash)
Aug 26 16:49:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:49:39 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:49:39 user nova-compute[73627]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c (non-flash)
Aug 26 16:49:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d442a37c-24b3-4966-ba87-13e2653e3b62]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:49:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGMJKnjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26462636331383337', 'path': '/dev/sdd'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462636331383337', 'path': '/dev/sdd'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG nova.objects.instance [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lazy-loading 'flavor' on Instance uuid 4ea0a009-4457-42f6-9c36-7b2325b73071 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:49:40 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:49:40 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:49:40 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:49:40 user nova-compute[73627]:   <serial>df7d09df-6a52-4c6a-80b4-682586d3719c</serial>
Aug 26 16:49:40 user nova-compute[73627]: </disk>
Aug 26 16:49:40 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73627) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:49:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] No VIF found with MAC fa:16:3e:2d:b5:db, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:49:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f6eb17d4-9501-4ea1-8ee2-5e36429878c8 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.048s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.818s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:49:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:49:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:43 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:49:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:49:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:50:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:50:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:50:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:50:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:17 user nova-compute[73627]: DEBUG nova.compute.manager [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:50:17 user nova-compute[73627]: INFO nova.compute.manager [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] instance snapshotting
Aug 26 16:50:17 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Beginning live snapshot process
Aug 26 16:50:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json -f qcow2 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:17 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json -f qcow2 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.191s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfokv6tpu/808b4b843bcc4e0ea87832b7130f7361.delta 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:18 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfokv6tpu/808b4b843bcc4e0ea87832b7130f7361.delta 1073741824" returned: 0 in 0.050s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:18 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 16:50:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:50:19 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] COPY block job progress, current cursor: 15728640 final cursor: 75563008 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:50:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73627) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 16:50:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 16:50:20 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:50:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfokv6tpu/808b4b843bcc4e0ea87832b7130f7361.delta /opt/stack/data/nova/instances/snapshots/tmpfokv6tpu/808b4b843bcc4e0ea87832b7130f7361 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:50:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfokv6tpu/808b4b843bcc4e0ea87832b7130f7361.delta /opt/stack/data/nova/instances/snapshots/tmpfokv6tpu/808b4b843bcc4e0ea87832b7130f7361" returned: 0 in 0.798s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:21 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Snapshot extracted, beginning image upload
Aug 26 16:50:21 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:50:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:50:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:50:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:50:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:50:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:50:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:50:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:23 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Snapshot image upload complete
Aug 26 16:50:23 user nova-compute[73627]: INFO nova.compute.manager [None req-81f65eb5-0d52-428c-a1c1-1c7a3bae633e tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Took 6.12 seconds to snapshot the instance on the hypervisor.
Aug 26 16:50:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-7c098bf3-d4d1-4aa6-9cb6-da709e71e301 req-9581d118-14b5-411c-9b13-021628688a53 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-changed-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-7c098bf3-d4d1-4aa6-9cb6-da709e71e301 req-9581d118-14b5-411c-9b13-021628688a53 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Refreshing instance network info cache due to event network-changed-d1ea0f7f-4d12-48a5-8475-225d76240606. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:50:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7c098bf3-d4d1-4aa6-9cb6-da709e71e301 req-9581d118-14b5-411c-9b13-021628688a53 service nova] Acquiring lock "refresh_cache-15f8eb12-dbeb-4ebf-9e05-f827bd49f318" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:50:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7c098bf3-d4d1-4aa6-9cb6-da709e71e301 req-9581d118-14b5-411c-9b13-021628688a53 service nova] Acquired lock "refresh_cache-15f8eb12-dbeb-4ebf-9e05-f827bd49f318" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:50:23 user nova-compute[73627]: DEBUG nova.network.neutron [req-7c098bf3-d4d1-4aa6-9cb6-da709e71e301 req-9581d118-14b5-411c-9b13-021628688a53 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Refreshing network info cache for port d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG nova.network.neutron [req-7c098bf3-d4d1-4aa6-9cb6-da709e71e301 req-9581d118-14b5-411c-9b13-021628688a53 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Updated VIF entry in instance network info cache for port d1ea0f7f-4d12-48a5-8475-225d76240606. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG nova.network.neutron [req-7c098bf3-d4d1-4aa6-9cb6-da709e71e301 req-9581d118-14b5-411c-9b13-021628688a53 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Updating instance_info_cache with network_info: [{"id": "d1ea0f7f-4d12-48a5-8475-225d76240606", "address": "fa:16:3e:f8:65:86", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1ea0f7f-4d", "ovs_interfaceid": "d1ea0f7f-4d12-48a5-8475-225d76240606", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7c098bf3-d4d1-4aa6-9cb6-da709e71e301 req-9581d118-14b5-411c-9b13-021628688a53 service nova] Releasing lock "refresh_cache-15f8eb12-dbeb-4ebf-9e05-f827bd49f318" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:24 user nova-compute[73627]: INFO nova.compute.manager [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Terminating instance
Aug 26 16:50:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-a6e763a5-5005-41d6-a220-2917d1572aaa req-065b974c-f4f7-4100-92e6-93e63352e882 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-vif-unplugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a6e763a5-5005-41d6-a220-2917d1572aaa req-065b974c-f4f7-4100-92e6-93e63352e882 service nova] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a6e763a5-5005-41d6-a220-2917d1572aaa req-065b974c-f4f7-4100-92e6-93e63352e882 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a6e763a5-5005-41d6-a220-2917d1572aaa req-065b974c-f4f7-4100-92e6-93e63352e882 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-a6e763a5-5005-41d6-a220-2917d1572aaa req-065b974c-f4f7-4100-92e6-93e63352e882 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] No waiting events found dispatching network-vif-unplugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-a6e763a5-5005-41d6-a220-2917d1572aaa req-065b974c-f4f7-4100-92e6-93e63352e882 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-vif-unplugged-d1ea0f7f-4d12-48a5-8475-225d76240606 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:25 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Instance destroyed successfully.
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.objects.instance [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'resources' on Instance uuid 15f8eb12-dbeb-4ebf-9e05-f827bd49f318 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:48:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-484602158',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-484602158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-484602158',id=43,image_ref='d8ac31fd-d6f9-4590-b080-e36cda88dfbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwgV+YNG5/keeWXMZbr4Vi+RhCV6vj3SUthwWdM9RXs2vxaQChYFZxdV2lHPtOrBKIO9xVEjAq2HHok9CO74E2HX9hqgVw6jlqyGiMWdozVVqYlFi1hzLBK+1XdaQNcIw==',key_name='tempest-keypair-1734562285',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-y9euhvwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1705344746',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=15f8eb12-dbeb-4ebf-9e05-f827bd49f318,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1ea0f7f-4d12-48a5-8475-225d76240606", "address": "fa:16:3e:f8:65:86", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1ea0f7f-4d", "ovs_interfaceid": "d1ea0f7f-4d12-48a5-8475-225d76240606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "d1ea0f7f-4d12-48a5-8475-225d76240606", "address": "fa:16:3e:f8:65:86", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1ea0f7f-4d", "ovs_interfaceid": "d1ea0f7f-4d12-48a5-8475-225d76240606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:65:86,bridge_name='br-int',has_traffic_filtering=True,id=d1ea0f7f-4d12-48a5-8475-225d76240606,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1ea0f7f-4d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_vif [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:65:86,bridge_name='br-int',has_traffic_filtering=True,id=d1ea0f7f-4d12-48a5-8475-225d76240606,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1ea0f7f-4d') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1ea0f7f-4d, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:50:25 user nova-compute[73627]: INFO os_vif [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:65:86,bridge_name='br-int',has_traffic_filtering=True,id=d1ea0f7f-4d12-48a5-8475-225d76240606,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1ea0f7f-4d')
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEusRUOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:50:25 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02bdc6c-4c00-4e35-a70d-cc07b99e2264]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7ac065-65a4-4f79-bdf7-145446d5046a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:50:25 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:50:25 user nova-compute[73627]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c (non-flash)
Aug 26 16:50:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:50:25 user nova-compute[73627]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 (non-flash)
Aug 26 16:50:25 user nova-compute[73627]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c (non-flash)
Aug 26 16:50:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e8303760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[40daac51-8429-4ec1-9a18-a76abe005500]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dec2a9d-02eb-4719-9083-532626fe70df]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffb9f44-94a2-4353-b970-43c67eec471f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5bc818-23a1-4b61-b5a9-dc92b4177ddb]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_891bf229', '/dev/disk/by-id/scsi-1SCST_BIO891bf229-9b9baa01e5acb0f6', '/dev/disk/by-id/scsi-23962396261613031') {{(pid=84800) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e1eb78-aeb5-442e-95a4-f22b3f550436]: (4, None) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c0c660-d202-49a1-bbde-1a6746c00c4d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1526dd9a-f84e-42b9-8fa7-897ff97b6f6e]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1, portal: 172.16.0.220,3260]
Aug 26 16:50:25 user nova-compute[73627]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1, portal: 172.16.0.220,3260] successful.
Aug 26 16:50:25 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edeeb009-a9e7-479a-a06b-2eafad4811b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a045028-18eb-4bc9-ae0e-3430a7a3829c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== disconnect_volume: return (316ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:50:25 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Deleting instance files /opt/stack/data/nova/instances/15f8eb12-dbeb-4ebf-9e05-f827bd49f318_del
Aug 26 16:50:25 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Deletion of /opt/stack/data/nova/instances/15f8eb12-dbeb-4ebf-9e05-f827bd49f318_del complete
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:50:25 user nova-compute[73627]: INFO nova.compute.claims [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Claim successful on node user
Aug 26 16:50:25 user nova-compute[73627]: INFO nova.compute.manager [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 26 16:50:25 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:50:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:50:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:50:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:50:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Creating image(s)
Aug 26 16:50:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "/opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "/opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "765b30e393e30bd65129db9cfab530f0a733684e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "765b30e393e30bd65129db9cfab530f0a733684e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:26 user nova-compute[73627]: DEBUG nova.policy [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23b0873451304eefb3eb0f8f01727182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4b851aec5746a68bb6cd57285b133a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e.part --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-fe7faea5-e30a-4314-959b-0dbe67b37005 req-773d0a36-e416-48c7-9c28-b4a95f8b6f27 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-vif-deleted-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:27 user nova-compute[73627]: INFO nova.compute.manager [req-fe7faea5-e30a-4314-959b-0dbe67b37005 req-773d0a36-e416-48c7-9c28-b4a95f8b6f27 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Neutron deleted interface d1ea0f7f-4d12-48a5-8475-225d76240606; detaching it from the instance and deleting it from the info cache
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.network.neutron [req-fe7faea5-e30a-4314-959b-0dbe67b37005 req-773d0a36-e416-48c7-9c28-b4a95f8b6f27 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] No waiting events found dispatching network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:27 user nova-compute[73627]: WARNING nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received unexpected event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 for instance with vm_state active and task_state deleting.
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] No waiting events found dispatching network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:27 user nova-compute[73627]: WARNING nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received unexpected event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 for instance with vm_state active and task_state deleting.
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] No waiting events found dispatching network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:27 user nova-compute[73627]: WARNING nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received unexpected event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 for instance with vm_state active and task_state deleting.
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-vif-unplugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] No waiting events found dispatching network-vif-unplugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-vif-unplugged-d1ea0f7f-4d12-48a5-8475-225d76240606 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Acquiring lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] No waiting events found dispatching network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:27 user nova-compute[73627]: WARNING nova.compute.manager [req-5416ba52-46c5-45f4-bcd8-86f142e0d400 req-ae5ebe5c-5bee-4348-a725-5ae33c067a79 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Received unexpected event network-vif-plugged-d1ea0f7f-4d12-48a5-8475-225d76240606 for instance with vm_state active and task_state deleting.
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-fe7faea5-e30a-4314-959b-0dbe67b37005 req-773d0a36-e416-48c7-9c28-b4a95f8b6f27 service nova] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Detach interface failed, port_id=d1ea0f7f-4d12-48a5-8475-225d76240606, reason: Instance 15f8eb12-dbeb-4ebf-9e05-f827bd49f318 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:50:27 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Took 1.70 seconds to deallocate network for instance.
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e.part --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.virt.images [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] 76cd1f3e-cd84-40f4-8024-e54f9e22656c was qcow2, converting to raw {{(pid=73627) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG nova.privsep.utils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73627) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e.part /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e.converted {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e.part /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e.converted" returned: 0 in 0.334s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e.converted --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e.converted --force-share --output=json" returned: 0 in 0.248s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "765b30e393e30bd65129db9cfab530f0a733684e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.895s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Updating instance_info_cache with network_info: [{"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-4ea0a009-4457-42f6-9c36-7b2325b73071" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "765b30e393e30bd65129db9cfab530f0a733684e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "765b30e393e30bd65129db9cfab530f0a733684e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e,backing_fmt=raw /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e,backing_fmt=raw /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk 1073741824" returned: 0 in 0.062s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "765b30e393e30bd65129db9cfab530f0a733684e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Successfully created port: 9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Ensure instance console log exists: /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:28 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:29 user nova-compute[73627]: INFO nova.compute.manager [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Took 1.55 seconds to detach 1 volumes for instance.
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Deleting volume: edeeb009-a9e7-479a-a06b-2eafad4811b1 {{(pid=73627) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:29 user nova-compute[73627]: INFO nova.compute.manager [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Detaching volume df7d09df-6a52-4c6a-80b4-682586d3719c
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:50:29 user nova-compute[73627]: INFO nova.virt.block_device [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Attempting to driver detach volume df7d09df-6a52-4c6a-80b4-682586d3719c from mountpoint /dev/vdb
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Attempting to detach device vdb from instance 4ea0a009-4457-42f6-9c36-7b2325b73071 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:50:29 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:50:29 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:50:29 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:50:29 user nova-compute[73627]:   <serial>df7d09df-6a52-4c6a-80b4-682586d3719c</serial>
Aug 26 16:50:29 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:50:29 user nova-compute[73627]: </disk>
Aug 26 16:50:29 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:50:29 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Successfully detached device vdb from instance 4ea0a009-4457-42f6-9c36-7b2325b73071 from the persistent domain config.
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ea0a009-4457-42f6-9c36-7b2325b73071 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:50:29 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:50:29 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:50:29 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:50:29 user nova-compute[73627]:   <serial>df7d09df-6a52-4c6a-80b4-682586d3719c</serial>
Aug 26 16:50:29 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:50:29 user nova-compute[73627]: </disk>
Aug 26 16:50:29 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:29 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Deleted allocations for instance 15f8eb12-dbeb-4ebf-9e05-f827bd49f318
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Successfully updated port: 9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-3c2b3c75-adc7-4314-907b-40c13d1fc177 req-ef29870c-ab54-4ec3-91e7-c8eb28591d0c service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received event network-changed-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.compute.manager [req-3c2b3c75-adc7-4314-907b-40c13d1fc177 req-ef29870c-ab54-4ec3-91e7-c8eb28591d0c service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Refreshing instance network info cache due to event network-changed-9eb26d05-fe20-4127-93b0-2a707e0a8e6b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3c2b3c75-adc7-4314-907b-40c13d1fc177 req-ef29870c-ab54-4ec3-91e7-c8eb28591d0c service nova] Acquiring lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3c2b3c75-adc7-4314-907b-40c13d1fc177 req-ef29870c-ab54-4ec3-91e7-c8eb28591d0c service nova] Acquired lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.network.neutron [req-3c2b3c75-adc7-4314-907b-40c13d1fc177 req-ef29870c-ab54-4ec3-91e7-c8eb28591d0c service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Refreshing network info cache for port 9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-7ab6d4aa-60a0-4d11-9708-dab1be7d590a tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "15f8eb12-dbeb-4ebf-9e05-f827bd49f318" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.221s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG nova.network.neutron [req-3c2b3c75-adc7-4314-907b-40c13d1fc177 req-ef29870c-ab54-4ec3-91e7-c8eb28591d0c service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.network.neutron [req-3c2b3c75-adc7-4314-907b-40c13d1fc177 req-ef29870c-ab54-4ec3-91e7-c8eb28591d0c service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-3c2b3c75-adc7-4314-907b-40c13d1fc177 req-ef29870c-ab54-4ec3-91e7-c8eb28591d0c service nova] Releasing lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquired lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693068630.1325872, 4ea0a009-4457-42f6-9c36-7b2325b73071 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ea0a009-4457-42f6-9c36-7b2325b73071 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:50:30 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Successfully detached device vdb from instance 4ea0a009-4457-42f6-9c36-7b2325b73071 from the live domain config.
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGMJKnjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:50:30 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe89994-deed-44e8-967a-f3f51776c9e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:50:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8341MB free_disk=25.12957763671875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14de765-e441-4e8f-92c7-000302b045bb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:50:30 user nova-compute[73627]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c (non-flash)
Aug 26 16:50:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:50:30 user nova-compute[73627]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c (non-flash)
Aug 26 16:50:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e820b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c'): ({'sdd'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Removing single pathed devices sdd {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70a4950-2f94-40b4-bba6-a5856cdee343]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d0c865-cf2f-4890-876d-b70e5d9d8105]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Flushing IO for device /dev/sdd {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c10abf7-062a-4026-aa88-1c38b3c47fed]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 2ffdcd8b-ac91-4686-82a6-79da99ddb253 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 4ea0a009-4457-42f6-9c36-7b2325b73071 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 228134a5-86c8-47bc-a34d-e0aba6b33e08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f2a34fb0-f8ac-479c-88cf-c565fedc0315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef9e4d2-4f4f-4cbf-9941-ff5e6a7519ff]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.070s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaac880-23c2-4fd9-8c37-0bffe9d82093]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c73b69-c83e-4ed6-9e71-443507e2aada]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c, portal: 172.16.0.220,3260]
Aug 26 16:50:30 user nova-compute[73627]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c, portal: 172.16.0.220,3260] successful.
Aug 26 16:50:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef0d9de-2915-4acb-913b-8a679d31619d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.695s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] <== disconnect_volume: return (696ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Updating instance_info_cache with network_info: [{"id": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "address": "fa:16:3e:78:b0:b6", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb26d05-fe", "ovs_interfaceid": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Releasing lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Instance network_info: |[{"id": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "address": "fa:16:3e:78:b0:b6", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb26d05-fe", "ovs_interfaceid": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Start _get_guest_xml network_info=[{"id": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "address": "fa:16:3e:78:b0:b6", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb26d05-fe", "ovs_interfaceid": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1668d9b7fb0c0f808fa7d6459ffb56f7',container_format='bare',created_at=2023-08-26T16:50:17Z,direct_url=<?>,disk_format='qcow2',id=76cd1f3e-cd84-40f4-8024-e54f9e22656c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2004823596',owner='2b4b851aec5746a68bb6cd57285b133a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T16:50:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '76cd1f3e-cd84-40f4-8024-e54f9e22656c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:50:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:50:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1668d9b7fb0c0f808fa7d6459ffb56f7',container_format='bare',created_at=2023-08-26T16:50:17Z,direct_url=<?>,disk_format='qcow2',id=76cd1f3e-cd84-40f4-8024-e54f9e22656c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2004823596',owner='2b4b851aec5746a68bb6cd57285b133a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T16:50:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-47338849',display_name='tempest-TestStampPattern-server-47338849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-47338849',id=45,image_ref='76cd1f3e-cd84-40f4-8024-e54f9e22656c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClm4sbJTbQecTTto7JpLosQLvUWuSSwBPYQ/9eVAIKa4x5C24J3npTbB1xGl2BdK0pMwRzKGeyIQQpilDlIlaAntYzFvMNplr4IkHrgY6/OLLZmaIAY+eAS/bXWwYiwgg==',key_name='tempest-TestStampPattern-599218896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b4b851aec5746a68bb6cd57285b133a',ramdisk_id='',reservation_id='r-sll1f41d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='faa17ff2-089a-4499-bde5-3b9314b3c4a7',image_min_disk='1',image_min_ram='0',image_owner_id='2b4b851aec5746a68bb6cd57285b133a',image_owner_project_name='tempest-TestStampPattern-1807109610',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1807109610-project-member',image_user_id='23b0873451304eefb3eb0f8f01727182',network_allocated='True',owner_project_name='tempest-TestStampPattern-1807109610',owner_user_name='tempest-TestStampPattern-1807109610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:50:26Z,user_data=None,user_id='23b0873451304eefb3eb0f8f01727182',uuid=f2a34fb0-f8ac-479c-88cf-c565fedc0315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "address": "fa:16:3e:78:b0:b6", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb26d05-fe", "ovs_interfaceid": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converting VIF {"id": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "address": "fa:16:3e:78:b0:b6", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb26d05-fe", "ovs_interfaceid": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:b0:b6,bridge_name='br-int',has_traffic_filtering=True,id=9eb26d05-fe20-4127-93b0-2a707e0a8e6b,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb26d05-fe') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.objects.instance [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lazy-loading 'pci_devices' on Instance uuid f2a34fb0-f8ac-479c-88cf-c565fedc0315 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:50:30 user nova-compute[73627]:   <uuid>f2a34fb0-f8ac-479c-88cf-c565fedc0315</uuid>
Aug 26 16:50:30 user nova-compute[73627]:   <name>instance-0000002d</name>
Aug 26 16:50:30 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:50:30 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:50:30 user nova-compute[73627]:   <metadata>
Aug 26 16:50:30 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:50:30 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:50:30 user nova-compute[73627]:       <nova:name>tempest-TestStampPattern-server-47338849</nova:name>
Aug 26 16:50:30 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:50:30</nova:creationTime>
Aug 26 16:50:30 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:50:30 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:50:30 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:50:30 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:50:30 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:50:30 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:50:30 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:50:30 user nova-compute[73627]:       <nova:owner>
Aug 26 16:50:30 user nova-compute[73627]:         <nova:user uuid="23b0873451304eefb3eb0f8f01727182">tempest-TestStampPattern-1807109610-project-member</nova:user>
Aug 26 16:50:30 user nova-compute[73627]:         <nova:project uuid="2b4b851aec5746a68bb6cd57285b133a">tempest-TestStampPattern-1807109610</nova:project>
Aug 26 16:50:30 user nova-compute[73627]:       </nova:owner>
Aug 26 16:50:30 user nova-compute[73627]:       <nova:root type="image" uuid="76cd1f3e-cd84-40f4-8024-e54f9e22656c"/>
Aug 26 16:50:30 user nova-compute[73627]:       <nova:ports>
Aug 26 16:50:30 user nova-compute[73627]:         <nova:port uuid="9eb26d05-fe20-4127-93b0-2a707e0a8e6b">
Aug 26 16:50:30 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 16:50:30 user nova-compute[73627]:         </nova:port>
Aug 26 16:50:30 user nova-compute[73627]:       </nova:ports>
Aug 26 16:50:30 user nova-compute[73627]:     </nova:instance>
Aug 26 16:50:30 user nova-compute[73627]:   </metadata>
Aug 26 16:50:30 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:50:30 user nova-compute[73627]:     <system>
Aug 26 16:50:30 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:50:30 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:50:30 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:50:30 user nova-compute[73627]:       <entry name="serial">f2a34fb0-f8ac-479c-88cf-c565fedc0315</entry>
Aug 26 16:50:30 user nova-compute[73627]:       <entry name="uuid">f2a34fb0-f8ac-479c-88cf-c565fedc0315</entry>
Aug 26 16:50:30 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:50:30 user nova-compute[73627]:     </system>
Aug 26 16:50:30 user nova-compute[73627]:   </sysinfo>
Aug 26 16:50:30 user nova-compute[73627]:   <os>
Aug 26 16:50:30 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:50:30 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:50:30 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:50:30 user nova-compute[73627]:   </os>
Aug 26 16:50:30 user nova-compute[73627]:   <features>
Aug 26 16:50:30 user nova-compute[73627]:     <acpi/>
Aug 26 16:50:30 user nova-compute[73627]:     <apic/>
Aug 26 16:50:30 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:50:30 user nova-compute[73627]:   </features>
Aug 26 16:50:30 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:50:30 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:50:30 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:50:30 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:50:30 user nova-compute[73627]:   </clock>
Aug 26 16:50:30 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:50:30 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:50:30 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:50:30 user nova-compute[73627]:   </cpu>
Aug 26 16:50:30 user nova-compute[73627]:   <devices>
Aug 26 16:50:30 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:50:30 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:50:30 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk"/>
Aug 26 16:50:30 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:50:30 user nova-compute[73627]:     </disk>
Aug 26 16:50:30 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:50:30 user nova-compute[73627]:       <mac address="fa:16:3e:78:b0:b6"/>
Aug 26 16:50:30 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:50:30 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:50:30 user nova-compute[73627]:       <target dev="tap9eb26d05-fe"/>
Aug 26 16:50:30 user nova-compute[73627]:     </interface>
Aug 26 16:50:30 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:50:30 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/console.log" append="off"/>
Aug 26 16:50:30 user nova-compute[73627]:     </serial>
Aug 26 16:50:30 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:50:30 user nova-compute[73627]:     <video>
Aug 26 16:50:30 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:50:30 user nova-compute[73627]:     </video>
Aug 26 16:50:30 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:50:30 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:50:30 user nova-compute[73627]:     </rng>
Aug 26 16:50:30 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:50:30 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:50:30 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:50:30 user nova-compute[73627]:     </memballoon>
Aug 26 16:50:30 user nova-compute[73627]:   </devices>
Aug 26 16:50:30 user nova-compute[73627]: </domain>
Aug 26 16:50:30 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-47338849',display_name='tempest-TestStampPattern-server-47338849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-47338849',id=45,image_ref='76cd1f3e-cd84-40f4-8024-e54f9e22656c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClm4sbJTbQecTTto7JpLosQLvUWuSSwBPYQ/9eVAIKa4x5C24J3npTbB1xGl2BdK0pMwRzKGeyIQQpilDlIlaAntYzFvMNplr4IkHrgY6/OLLZmaIAY+eAS/bXWwYiwgg==',key_name='tempest-TestStampPattern-599218896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b4b851aec5746a68bb6cd57285b133a',ramdisk_id='',reservation_id='r-sll1f41d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='faa17ff2-089a-4499-bde5-3b9314b3c4a7',image_min_disk='1',image_min_ram='0',image_owner_id='2b4b851aec5746a68bb6cd57285b133a',image_owner_project_name='tempest-TestStampPattern-1807109610',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1807109610-project-member',image_user_id='23b0873451304eefb3eb0f8f01727182',network_allocated='True',owner_project_name='tempest-TestStampPattern-1807109610',owner_user_name='tempest-TestStampPattern-1807109610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:50:26Z,user_data=None,user_id='23b0873451304eefb3eb0f8f01727182',uuid=f2a34fb0-f8ac-479c-88cf-c565fedc0315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "address": "fa:16:3e:78:b0:b6", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb26d05-fe", "ovs_interfaceid": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converting VIF {"id": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "address": "fa:16:3e:78:b0:b6", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb26d05-fe", "ovs_interfaceid": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:b0:b6,bridge_name='br-int',has_traffic_filtering=True,id=9eb26d05-fe20-4127-93b0-2a707e0a8e6b,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb26d05-fe') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG os_vif [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:b0:b6,bridge_name='br-int',has_traffic_filtering=True,id=9eb26d05-fe20-4127-93b0-2a707e0a8e6b,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb26d05-fe') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9eb26d05-fe, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9eb26d05-fe, col_values=(('external_ids', {'iface-id': '9eb26d05-fe20-4127-93b0-2a707e0a8e6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:b0:b6', 'vm-uuid': 'f2a34fb0-f8ac-479c-88cf-c565fedc0315'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:50:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:30 user nova-compute[73627]: INFO os_vif [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:b0:b6,bridge_name='br-int',has_traffic_filtering=True,id=9eb26d05-fe20-4127-93b0-2a707e0a8e6b,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb26d05-fe')
Aug 26 16:50:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] No VIF found with MAC fa:16:3e:78:b0:b6, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lazy-loading 'flavor' on Instance uuid 4ea0a009-4457-42f6-9c36-7b2325b73071 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9def6ce1-0667-4625-8dc7-cc1baf285dfd tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.169s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.043s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:31 user nova-compute[73627]: INFO nova.compute.manager [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Terminating instance
Aug 26 16:50:31 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-39ac5cd6-a02a-4b87-a801-a3137c1f87fe req-8ed03c15-fb70-413b-a117-5f978b042e1d service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-vif-unplugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-39ac5cd6-a02a-4b87-a801-a3137c1f87fe req-8ed03c15-fb70-413b-a117-5f978b042e1d service nova] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-39ac5cd6-a02a-4b87-a801-a3137c1f87fe req-8ed03c15-fb70-413b-a117-5f978b042e1d service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-39ac5cd6-a02a-4b87-a801-a3137c1f87fe req-8ed03c15-fb70-413b-a117-5f978b042e1d service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-39ac5cd6-a02a-4b87-a801-a3137c1f87fe req-8ed03c15-fb70-413b-a117-5f978b042e1d service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] No waiting events found dispatching network-vif-unplugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-39ac5cd6-a02a-4b87-a801-a3137c1f87fe req-8ed03c15-fb70-413b-a117-5f978b042e1d service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-vif-unplugged-c714f5c2-5c80-432c-a360-b689eead7360 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:32 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Instance destroyed successfully.
Aug 26 16:50:32 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lazy-loading 'resources' on Instance uuid 4ea0a009-4457-42f6-9c36-7b2325b73071 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:47:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2061154556',display_name='tempest-VolumesSnapshotTestJSON-instance-2061154556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2061154556',id=42,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgB359csoIAZ/lCAE/y1YujQtoF+PoW2X36uyo8ss0EBB/Kfyl2Ne+B4kal964hjEVfRw4opSYqUM1gRKwya3fsbQWsw3C/M1mPX3lrHvaSAe3jgk4PZtkiNkJtpu2yvw==',key_name='tempest-keypair-1975616310',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:47:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1550b44802843dca4d2f8ad38adbc12',ramdisk_id='',reservation_id='r-wnzyiox0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-351265767',owner_user_name='tempest-VolumesSnapshotTestJSON-351265767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3725a470efe84258825ac4db497f6761',uuid=4ea0a009-4457-42f6-9c36-7b2325b73071,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converting VIF {"id": "c714f5c2-5c80-432c-a360-b689eead7360", "address": "fa:16:3e:2d:b5:db", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc714f5c2-5c", "ovs_interfaceid": "c714f5c2-5c80-432c-a360-b689eead7360", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:b5:db,bridge_name='br-int',has_traffic_filtering=True,id=c714f5c2-5c80-432c-a360-b689eead7360,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc714f5c2-5c') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG os_vif [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:b5:db,bridge_name='br-int',has_traffic_filtering=True,id=c714f5c2-5c80-432c-a360-b689eead7360,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc714f5c2-5c') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc714f5c2-5c, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:32 user nova-compute[73627]: INFO os_vif [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:b5:db,bridge_name='br-int',has_traffic_filtering=True,id=c714f5c2-5c80-432c-a360-b689eead7360,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc714f5c2-5c')
Aug 26 16:50:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGMJKnjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:50:32 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:50:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df7d09df-6a52-4c6a-80b4-682586d3719c', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6004208-0a61-4a61-8274-00eefeec762b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebea565-049f-4be8-ad8f-c3168eb23dbb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:50:32 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:50:32 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d01a1e10>, {}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Disconnecting from: [] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] <== disconnect_volume: return (64ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:50:32 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Deleting instance files /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071_del
Aug 26 16:50:32 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Deletion of /opt/stack/data/nova/instances/4ea0a009-4457-42f6-9c36-7b2325b73071_del complete
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:50:32 user nova-compute[73627]: INFO nova.compute.manager [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG nova.compute.manager [req-b9b9a59a-570f-4667-917d-db04056fc333 req-c955a710-6481-4877-a09b-3a3b8f0bb6e1 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received event network-vif-plugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b9b9a59a-570f-4667-917d-db04056fc333 req-c955a710-6481-4877-a09b-3a3b8f0bb6e1 service nova] Acquiring lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b9b9a59a-570f-4667-917d-db04056fc333 req-c955a710-6481-4877-a09b-3a3b8f0bb6e1 service nova] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b9b9a59a-570f-4667-917d-db04056fc333 req-c955a710-6481-4877-a09b-3a3b8f0bb6e1 service nova] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:32 user nova-compute[73627]: DEBUG nova.compute.manager [req-b9b9a59a-570f-4667-917d-db04056fc333 req-c955a710-6481-4877-a09b-3a3b8f0bb6e1 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] No waiting events found dispatching network-vif-plugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:32 user nova-compute[73627]: WARNING nova.compute.manager [req-b9b9a59a-570f-4667-917d-db04056fc333 req-c955a710-6481-4877-a09b-3a3b8f0bb6e1 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received unexpected event network-vif-plugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b for instance with vm_state building and task_state spawning.
Aug 26 16:50:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] No waiting events found dispatching network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:34 user nova-compute[73627]: WARNING nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received unexpected event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 for instance with vm_state active and task_state deleting.
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] No waiting events found dispatching network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:34 user nova-compute[73627]: WARNING nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received unexpected event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 for instance with vm_state active and task_state deleting.
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] No waiting events found dispatching network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:34 user nova-compute[73627]: WARNING nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received unexpected event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 for instance with vm_state active and task_state deleting.
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-vif-unplugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] No waiting events found dispatching network-vif-unplugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-vif-unplugged-c714f5c2-5c80-432c-a360-b689eead7360 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Acquiring lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] No waiting events found dispatching network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:34 user nova-compute[73627]: WARNING nova.compute.manager [req-173fa674-1f8b-4178-8b84-84c1e7f8a4e7 req-4cf2df6e-f3ef-4cc2-b6cc-a8fa00d16626 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received unexpected event network-vif-plugged-c714f5c2-5c80-432c-a360-b689eead7360 for instance with vm_state active and task_state deleting.
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:50:34 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Took 1.31 seconds to deallocate network for instance.
Aug 26 16:50:34 user nova-compute[73627]: WARNING nova.volume.cinder [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Attachment 7934b882-ce94-4fc4-af95-373d5f4a52fd does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7934b882-ce94-4fc4-af95-373d5f4a52fd. (HTTP 404) (Request-ID: req-e8125f0a-f3a9-49a6-8013-6326da0dc413)
Aug 26 16:50:34 user nova-compute[73627]: INFO nova.compute.manager [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Took 0.03 seconds to detach 1 volumes for instance.
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:34 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Deleted allocations for instance 4ea0a009-4457-42f6-9c36-7b2325b73071
Aug 26 16:50:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e8784d8f-cd61-4bd1-8c58-43ee19b9a183 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "4ea0a009-4457-42f6-9c36-7b2325b73071" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.018s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068634.9428341, f2a34fb0-f8ac-479c-88cf-c565fedc0315 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:50:34 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] VM Resumed (Lifecycle Event)
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:50:34 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Instance spawned successfully.
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:50:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:50:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:50:35 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068634.9440918, f2a34fb0-f8ac-479c-88cf-c565fedc0315 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:50:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] VM Started (Lifecycle Event)
Aug 26 16:50:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:50:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:50:35 user nova-compute[73627]: DEBUG nova.compute.manager [req-a7cd4caf-6602-4754-a252-662895fd6d20 req-aad1bc97-2f21-4eee-af5c-0a9223502bf7 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received event network-vif-plugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7cd4caf-6602-4754-a252-662895fd6d20 req-aad1bc97-2f21-4eee-af5c-0a9223502bf7 service nova] Acquiring lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:50:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7cd4caf-6602-4754-a252-662895fd6d20 req-aad1bc97-2f21-4eee-af5c-0a9223502bf7 service nova] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:50:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7cd4caf-6602-4754-a252-662895fd6d20 req-aad1bc97-2f21-4eee-af5c-0a9223502bf7 service nova] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:35 user nova-compute[73627]: DEBUG nova.compute.manager [req-a7cd4caf-6602-4754-a252-662895fd6d20 req-aad1bc97-2f21-4eee-af5c-0a9223502bf7 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] No waiting events found dispatching network-vif-plugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:50:35 user nova-compute[73627]: WARNING nova.compute.manager [req-a7cd4caf-6602-4754-a252-662895fd6d20 req-aad1bc97-2f21-4eee-af5c-0a9223502bf7 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received unexpected event network-vif-plugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b for instance with vm_state building and task_state spawning.
Aug 26 16:50:35 user nova-compute[73627]: DEBUG nova.compute.manager [req-a7cd4caf-6602-4754-a252-662895fd6d20 req-aad1bc97-2f21-4eee-af5c-0a9223502bf7 service nova] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Received event network-vif-deleted-c714f5c2-5c80-432c-a360-b689eead7360 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:50:35 user nova-compute[73627]: INFO nova.compute.manager [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Took 8.69 seconds to spawn the instance on the hypervisor.
Aug 26 16:50:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:50:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:50:35 user nova-compute[73627]: INFO nova.compute.manager [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Took 9.41 seconds to build instance.
Aug 26 16:50:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a48b8ba8-31c9-4339-a314-26243ee5a90f tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.542s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:50:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:40 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068625.368821, 15f8eb12-dbeb-4ebf-9e05-f827bd49f318 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:50:40 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] VM Stopped (Lifecycle Event)
Aug 26 16:50:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-193e0e9e-ccc0-48b3-8089-f56281384054 None None] [instance: 15f8eb12-dbeb-4ebf-9e05-f827bd49f318] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:50:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:50:47 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068632.6731763, 4ea0a009-4457-42f6-9c36-7b2325b73071 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:50:47 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] VM Stopped (Lifecycle Event)
Aug 26 16:50:47 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e10f6093-e1e9-46f6-9bab-29fd4faec2d2 None None] [instance: 4ea0a009-4457-42f6-9c36-7b2325b73071] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:50:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:50:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:50:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:51:01 user nova-compute[73627]: INFO nova.compute.claims [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Claim successful on node user
Aug 26 16:51:01 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:51:01 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:51:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG nova.policy [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a771feb2513a4866a1209f1abf754e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddffe7ec6b14545bd7f8d741be7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:51:01 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Creating image(s)
Aug 26 16:51:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "/opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "/opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "/opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:01 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk 1073741824" returned: 0 in 0.081s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Successfully created port: c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.271s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Cannot resize image /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Ensure instance console log exists: /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Successfully updated port: c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "refresh_cache-c047d4a9-c99b-4c02-b5de-2c654bdfc558" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquired lock "refresh_cache-c047d4a9-c99b-4c02-b5de-2c654bdfc558" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.compute.manager [req-db1315e9-59c1-44ff-b64b-4aecd93f2d51 req-ee33121c-e48c-4abb-9da2-440ab7be80e9 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received event network-changed-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.compute.manager [req-db1315e9-59c1-44ff-b64b-4aecd93f2d51 req-ee33121c-e48c-4abb-9da2-440ab7be80e9 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Refreshing instance network info cache due to event network-changed-c894d56a-baa6-44fc-9a53-45c90fa5195d. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-db1315e9-59c1-44ff-b64b-4aecd93f2d51 req-ee33121c-e48c-4abb-9da2-440ab7be80e9 service nova] Acquiring lock "refresh_cache-c047d4a9-c99b-4c02-b5de-2c654bdfc558" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.network.neutron [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Updating instance_info_cache with network_info: [{"id": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "address": "fa:16:3e:15:f2:97", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc894d56a-ba", "ovs_interfaceid": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Releasing lock "refresh_cache-c047d4a9-c99b-4c02-b5de-2c654bdfc558" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Instance network_info: |[{"id": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "address": "fa:16:3e:15:f2:97", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc894d56a-ba", "ovs_interfaceid": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-db1315e9-59c1-44ff-b64b-4aecd93f2d51 req-ee33121c-e48c-4abb-9da2-440ab7be80e9 service nova] Acquired lock "refresh_cache-c047d4a9-c99b-4c02-b5de-2c654bdfc558" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.network.neutron [req-db1315e9-59c1-44ff-b64b-4aecd93f2d51 req-ee33121c-e48c-4abb-9da2-440ab7be80e9 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Refreshing network info cache for port c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Start _get_guest_xml network_info=[{"id": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "address": "fa:16:3e:15:f2:97", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc894d56a-ba", "ovs_interfaceid": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:51:03 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:51:03 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1555536829',display_name='tempest-ServersNegativeTestJSON-server-1555536829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1555536829',id=46,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ddffe7ec6b14545bd7f8d741be7c4a2',ramdisk_id='',reservation_id='r-h8i2ykck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2065687253',owner_user_name='tempest-ServersNegativeTestJSON-2065687253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:51:02Z,user_data=None,user_id='a771feb2513a4866a1209f1abf754e8c',uuid=c047d4a9-c99b-4c02-b5de-2c654bdfc558,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "address": "fa:16:3e:15:f2:97", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc894d56a-ba", "ovs_interfaceid": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converting VIF {"id": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "address": "fa:16:3e:15:f2:97", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc894d56a-ba", "ovs_interfaceid": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:f2:97,bridge_name='br-int',has_traffic_filtering=True,id=c894d56a-baa6-44fc-9a53-45c90fa5195d,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc894d56a-ba') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.objects.instance [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lazy-loading 'pci_devices' on Instance uuid c047d4a9-c99b-4c02-b5de-2c654bdfc558 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:51:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:51:03 user nova-compute[73627]:   <uuid>c047d4a9-c99b-4c02-b5de-2c654bdfc558</uuid>
Aug 26 16:51:03 user nova-compute[73627]:   <name>instance-0000002e</name>
Aug 26 16:51:03 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:51:03 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:51:03 user nova-compute[73627]:   <metadata>
Aug 26 16:51:03 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:51:03 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:51:03 user nova-compute[73627]:       <nova:name>tempest-ServersNegativeTestJSON-server-1555536829</nova:name>
Aug 26 16:51:03 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:51:03</nova:creationTime>
Aug 26 16:51:03 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:51:03 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:51:03 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:51:03 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:51:03 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:51:03 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:51:03 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:51:03 user nova-compute[73627]:       <nova:owner>
Aug 26 16:51:03 user nova-compute[73627]:         <nova:user uuid="a771feb2513a4866a1209f1abf754e8c">tempest-ServersNegativeTestJSON-2065687253-project-member</nova:user>
Aug 26 16:51:03 user nova-compute[73627]:         <nova:project uuid="6ddffe7ec6b14545bd7f8d741be7c4a2">tempest-ServersNegativeTestJSON-2065687253</nova:project>
Aug 26 16:51:03 user nova-compute[73627]:       </nova:owner>
Aug 26 16:51:03 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:51:03 user nova-compute[73627]:       <nova:ports>
Aug 26 16:51:03 user nova-compute[73627]:         <nova:port uuid="c894d56a-baa6-44fc-9a53-45c90fa5195d">
Aug 26 16:51:03 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 16:51:03 user nova-compute[73627]:         </nova:port>
Aug 26 16:51:03 user nova-compute[73627]:       </nova:ports>
Aug 26 16:51:03 user nova-compute[73627]:     </nova:instance>
Aug 26 16:51:03 user nova-compute[73627]:   </metadata>
Aug 26 16:51:03 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:51:03 user nova-compute[73627]:     <system>
Aug 26 16:51:03 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:51:03 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:51:03 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:51:03 user nova-compute[73627]:       <entry name="serial">c047d4a9-c99b-4c02-b5de-2c654bdfc558</entry>
Aug 26 16:51:03 user nova-compute[73627]:       <entry name="uuid">c047d4a9-c99b-4c02-b5de-2c654bdfc558</entry>
Aug 26 16:51:03 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:51:03 user nova-compute[73627]:     </system>
Aug 26 16:51:03 user nova-compute[73627]:   </sysinfo>
Aug 26 16:51:03 user nova-compute[73627]:   <os>
Aug 26 16:51:03 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:51:03 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:51:03 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:51:03 user nova-compute[73627]:   </os>
Aug 26 16:51:03 user nova-compute[73627]:   <features>
Aug 26 16:51:03 user nova-compute[73627]:     <acpi/>
Aug 26 16:51:03 user nova-compute[73627]:     <apic/>
Aug 26 16:51:03 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:51:03 user nova-compute[73627]:   </features>
Aug 26 16:51:03 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:51:03 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:51:03 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:51:03 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:51:03 user nova-compute[73627]:   </clock>
Aug 26 16:51:03 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:51:03 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:51:03 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:51:03 user nova-compute[73627]:   </cpu>
Aug 26 16:51:03 user nova-compute[73627]:   <devices>
Aug 26 16:51:03 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:51:03 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:51:03 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk"/>
Aug 26 16:51:03 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:51:03 user nova-compute[73627]:     </disk>
Aug 26 16:51:03 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:51:03 user nova-compute[73627]:       <mac address="fa:16:3e:15:f2:97"/>
Aug 26 16:51:03 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:51:03 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:51:03 user nova-compute[73627]:       <target dev="tapc894d56a-ba"/>
Aug 26 16:51:03 user nova-compute[73627]:     </interface>
Aug 26 16:51:03 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:51:03 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/console.log" append="off"/>
Aug 26 16:51:03 user nova-compute[73627]:     </serial>
Aug 26 16:51:03 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:51:03 user nova-compute[73627]:     <video>
Aug 26 16:51:03 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:51:03 user nova-compute[73627]:     </video>
Aug 26 16:51:03 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:51:03 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:51:03 user nova-compute[73627]:     </rng>
Aug 26 16:51:03 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:51:03 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:51:03 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:51:03 user nova-compute[73627]:     </memballoon>
Aug 26 16:51:03 user nova-compute[73627]:   </devices>
Aug 26 16:51:03 user nova-compute[73627]: </domain>
Aug 26 16:51:03 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1555536829',display_name='tempest-ServersNegativeTestJSON-server-1555536829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1555536829',id=46,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ddffe7ec6b14545bd7f8d741be7c4a2',ramdisk_id='',reservation_id='r-h8i2ykck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2065687253',owner_user_name='tempest-ServersNegativeTestJSON-2065687253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:51:02Z,user_data=None,user_id='a771feb2513a4866a1209f1abf754e8c',uuid=c047d4a9-c99b-4c02-b5de-2c654bdfc558,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "address": "fa:16:3e:15:f2:97", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc894d56a-ba", "ovs_interfaceid": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converting VIF {"id": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "address": "fa:16:3e:15:f2:97", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc894d56a-ba", "ovs_interfaceid": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:f2:97,bridge_name='br-int',has_traffic_filtering=True,id=c894d56a-baa6-44fc-9a53-45c90fa5195d,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc894d56a-ba') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG os_vif [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f2:97,bridge_name='br-int',has_traffic_filtering=True,id=c894d56a-baa6-44fc-9a53-45c90fa5195d,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc894d56a-ba') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc894d56a-ba, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc894d56a-ba, col_values=(('external_ids', {'iface-id': 'c894d56a-baa6-44fc-9a53-45c90fa5195d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:f2:97', 'vm-uuid': 'c047d4a9-c99b-4c02-b5de-2c654bdfc558'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:04 user nova-compute[73627]: INFO os_vif [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f2:97,bridge_name='br-int',has_traffic_filtering=True,id=c894d56a-baa6-44fc-9a53-45c90fa5195d,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc894d56a-ba')
Aug 26 16:51:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] No VIF found with MAC fa:16:3e:15:f2:97, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-db1315e9-59c1-44ff-b64b-4aecd93f2d51 req-ee33121c-e48c-4abb-9da2-440ab7be80e9 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Updated VIF entry in instance network info cache for port c894d56a-baa6-44fc-9a53-45c90fa5195d. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-db1315e9-59c1-44ff-b64b-4aecd93f2d51 req-ee33121c-e48c-4abb-9da2-440ab7be80e9 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Updating instance_info_cache with network_info: [{"id": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "address": "fa:16:3e:15:f2:97", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc894d56a-ba", "ovs_interfaceid": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:51:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-db1315e9-59c1-44ff-b64b-4aecd93f2d51 req-ee33121c-e48c-4abb-9da2-440ab7be80e9 service nova] Releasing lock "refresh_cache-c047d4a9-c99b-4c02-b5de-2c654bdfc558" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:51:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-aeb65107-2cb9-4009-817f-1e78cd77159d req-e391de6b-bc2d-4ff2-9166-bfb2a7192825 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:51:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aeb65107-2cb9-4009-817f-1e78cd77159d req-e391de6b-bc2d-4ff2-9166-bfb2a7192825 service nova] Acquiring lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aeb65107-2cb9-4009-817f-1e78cd77159d req-e391de6b-bc2d-4ff2-9166-bfb2a7192825 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:05 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-aeb65107-2cb9-4009-817f-1e78cd77159d req-e391de6b-bc2d-4ff2-9166-bfb2a7192825 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:05 user nova-compute[73627]: DEBUG nova.compute.manager [req-aeb65107-2cb9-4009-817f-1e78cd77159d req-e391de6b-bc2d-4ff2-9166-bfb2a7192825 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] No waiting events found dispatching network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:51:05 user nova-compute[73627]: WARNING nova.compute.manager [req-aeb65107-2cb9-4009-817f-1e78cd77159d req-e391de6b-bc2d-4ff2-9166-bfb2a7192825 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received unexpected event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d for instance with vm_state building and task_state spawning.
Aug 26 16:51:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068667.5588078, c047d4a9-c99b-4c02-b5de-2c654bdfc558 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:51:07 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] VM Resumed (Lifecycle Event)
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:51:07 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Instance spawned successfully.
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:51:07 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068667.560896, c047d4a9-c99b-4c02-b5de-2c654bdfc558 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:51:07 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] VM Started (Lifecycle Event)
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:51:07 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:51:07 user nova-compute[73627]: INFO nova.compute.manager [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Took 5.74 seconds to spawn the instance on the hypervisor.
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-4a48a3a2-2651-402d-a69a-95686f64c0f9 req-ad90cff3-e02d-4c9c-b309-ebf787b276f8 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4a48a3a2-2651-402d-a69a-95686f64c0f9 req-ad90cff3-e02d-4c9c-b309-ebf787b276f8 service nova] Acquiring lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4a48a3a2-2651-402d-a69a-95686f64c0f9 req-ad90cff3-e02d-4c9c-b309-ebf787b276f8 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4a48a3a2-2651-402d-a69a-95686f64c0f9 req-ad90cff3-e02d-4c9c-b309-ebf787b276f8 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-4a48a3a2-2651-402d-a69a-95686f64c0f9 req-ad90cff3-e02d-4c9c-b309-ebf787b276f8 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] No waiting events found dispatching network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:51:07 user nova-compute[73627]: WARNING nova.compute.manager [req-4a48a3a2-2651-402d-a69a-95686f64c0f9 req-ad90cff3-e02d-4c9c-b309-ebf787b276f8 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received unexpected event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d for instance with vm_state building and task_state spawning.
Aug 26 16:51:07 user nova-compute[73627]: INFO nova.compute.manager [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Took 6.33 seconds to build instance.
Aug 26 16:51:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-1c4c2b5b-0645-45b3-90dc-900b750f292e tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.426s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:21 user nova-compute[73627]: INFO nova.compute.manager [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Terminating instance
Aug 26 16:51:21 user nova-compute[73627]: DEBUG nova.compute.manager [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-5342b927-6859-4abd-9228-11c42fb8b513 req-b740c553-15e5-479e-b6f6-a62f9785f992 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Received event network-vif-unplugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5342b927-6859-4abd-9228-11c42fb8b513 req-b740c553-15e5-479e-b6f6-a62f9785f992 service nova] Acquiring lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5342b927-6859-4abd-9228-11c42fb8b513 req-b740c553-15e5-479e-b6f6-a62f9785f992 service nova] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5342b927-6859-4abd-9228-11c42fb8b513 req-b740c553-15e5-479e-b6f6-a62f9785f992 service nova] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-5342b927-6859-4abd-9228-11c42fb8b513 req-b740c553-15e5-479e-b6f6-a62f9785f992 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] No waiting events found dispatching network-vif-unplugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:51:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-5342b927-6859-4abd-9228-11c42fb8b513 req-b740c553-15e5-479e-b6f6-a62f9785f992 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Received event network-vif-unplugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:51:22 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Instance destroyed successfully.
Aug 26 16:51:22 user nova-compute[73627]: DEBUG nova.objects.instance [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'resources' on Instance uuid 2ffdcd8b-ac91-4686-82a6-79da99ddb253 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-250811163',display_name='tempest-TestVolumeBootPattern-volume-backed-server-250811163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-250811163',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYg7IOmfKX+uA5znZn3yzQm51fDcPmWADFpvXy60Gs4v1O2mO6J54jjq2IwLwd0EHl+jhnJy2Lb+nMAPBtt1lM7su2taXd4CD3gM/YuGjDQoV3K1Hsv1ISil+0WFfqNvA==',key_name='tempest-keypair-295273271',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-fehc7tb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=2ffdcd8b-ac91-4686-82a6-79da99ddb253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "address": "fa:16:3e:72:da:e9", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fa00c5-3d", "ovs_interfaceid": "15fa00c5-3dd3-491b-8b5b-07cbd181a381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:da:e9,bridge_name='br-int',has_traffic_filtering=True,id=15fa00c5-3dd3-491b-8b5b-07cbd181a381,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fa00c5-3d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_vif [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:da:e9,bridge_name='br-int',has_traffic_filtering=True,id=15fa00c5-3dd3-491b-8b5b-07cbd181a381,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fa00c5-3d') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15fa00c5-3d, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:51:22 user nova-compute[73627]: INFO os_vif [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:da:e9,bridge_name='br-int',has_traffic_filtering=True,id=15fa00c5-3dd3-491b-8b5b-07cbd181a381,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fa00c5-3d')
Aug 26 16:51:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAkaQnSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:51:22 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f8e4e6-0798-42d1-8b38-8271f967e0a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcf52df-87a8-4165-828d-a225c6569104]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:51:22 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 (non-flash)
Aug 26 16:51:22 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e83029e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c166c6c-0ba0-4c82-87c1-e24af3b45b61]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c602a53f-d776-401b-9918-3f954a375bae]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d02d61-3cda-4c20-b88f-29e158a6d748]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5939bfce-d0b0-4b26-9b99-84c4184438fa]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_80a288c2', '/dev/disk/by-id/scsi-1SCST_BIO80a288c2-9907efb6ef2c637b', '/dev/disk/by-id/scsi-23939303765666236') {{(pid=84800) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77f8414-70b1-4af4-94a1-27fee2f4be7e]: (4, None) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed65056-b6cd-4684-9ec5-4aff32723520]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0424741a-9b45-4071-a924-f5b8744531d3]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723, portal: 172.16.0.220,3260]
Aug 26 16:51:22 user nova-compute[73627]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723, portal: 172.16.0.220,3260] successful.
Aug 26 16:51:22 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314f6dac-5d65-4d29-a9d7-4dcf3d728723 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[826d150d-a96e-432f-b172-19c1db7e60f4]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== disconnect_volume: return (283ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:51:22 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Deleting instance files /opt/stack/data/nova/instances/2ffdcd8b-ac91-4686-82a6-79da99ddb253_del
Aug 26 16:51:22 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Deletion of /opt/stack/data/nova/instances/2ffdcd8b-ac91-4686-82a6-79da99ddb253_del complete
Aug 26 16:51:22 user nova-compute[73627]: INFO nova.compute.manager [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:51:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:51:23 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:51:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-8f0e5592-dd3e-4801-8534-5654d88e4076 req-567e912d-f623-4c99-a86f-4bbdf5a8fee1 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Received event network-vif-plugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:51:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8f0e5592-dd3e-4801-8534-5654d88e4076 req-567e912d-f623-4c99-a86f-4bbdf5a8fee1 service nova] Acquiring lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8f0e5592-dd3e-4801-8534-5654d88e4076 req-567e912d-f623-4c99-a86f-4bbdf5a8fee1 service nova] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8f0e5592-dd3e-4801-8534-5654d88e4076 req-567e912d-f623-4c99-a86f-4bbdf5a8fee1 service nova] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-8f0e5592-dd3e-4801-8534-5654d88e4076 req-567e912d-f623-4c99-a86f-4bbdf5a8fee1 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] No waiting events found dispatching network-vif-plugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:51:23 user nova-compute[73627]: WARNING nova.compute.manager [req-8f0e5592-dd3e-4801-8534-5654d88e4076 req-567e912d-f623-4c99-a86f-4bbdf5a8fee1 service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Received unexpected event network-vif-plugged-15fa00c5-3dd3-491b-8b5b-07cbd181a381 for instance with vm_state active and task_state deleting.
Aug 26 16:51:23 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:51:23 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Took 1.27 seconds to deallocate network for instance.
Aug 26 16:51:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-b9f6edc2-ca4e-4961-8e6d-f1f441b47010 req-95801cab-791a-4fa6-84ec-c0dc7992d9ba service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Received event network-vif-deleted-15fa00c5-3dd3-491b-8b5b-07cbd181a381 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:51:23 user nova-compute[73627]: INFO nova.compute.manager [req-b9f6edc2-ca4e-4961-8e6d-f1f441b47010 req-95801cab-791a-4fa6-84ec-c0dc7992d9ba service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Neutron deleted interface 15fa00c5-3dd3-491b-8b5b-07cbd181a381; detaching it from the instance and deleting it from the info cache
Aug 26 16:51:23 user nova-compute[73627]: DEBUG nova.network.neutron [req-b9f6edc2-ca4e-4961-8e6d-f1f441b47010 req-95801cab-791a-4fa6-84ec-c0dc7992d9ba service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:51:23 user nova-compute[73627]: DEBUG nova.compute.manager [req-b9f6edc2-ca4e-4961-8e6d-f1f441b47010 req-95801cab-791a-4fa6-84ec-c0dc7992d9ba service nova] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Detach interface failed, port_id=15fa00c5-3dd3-491b-8b5b-07cbd181a381, reason: Instance 2ffdcd8b-ac91-4686-82a6-79da99ddb253 could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 16:51:24 user nova-compute[73627]: INFO nova.compute.manager [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Took 0.74 seconds to detach 1 volumes for instance.
Aug 26 16:51:24 user nova-compute[73627]: DEBUG nova.compute.manager [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Deleting volume: 314f6dac-5d65-4d29-a9d7-4dcf3d728723 {{(pid=73627) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 16:51:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:24 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:51:24 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:51:24 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:24 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Deleted allocations for instance 2ffdcd8b-ac91-4686-82a6-79da99ddb253
Aug 26 16:51:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-19e05c0d-d2f2-4dcb-bd24-457afa0a8abd tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "2ffdcd8b-ac91-4686-82a6-79da99ddb253" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.602s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:26 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:51:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:51:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:51:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:51:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:51:26 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:51:26 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid faa17ff2-089a-4499-bde5-3b9314b3c4a7 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:51:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:27 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updating instance_info_cache with network_info: [{"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:51:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:51:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:51:28 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:51:29 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:51:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:29 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:51:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:31 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:51:31 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:51:31 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8260MB free_disk=25.118667602539062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 228134a5-86c8-47bc-a34d-e0aba6b33e08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f2a34fb0-f8ac-479c-88cf-c565fedc0315 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c047d4a9-c99b-4c02-b5de-2c654bdfc558 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:51:31 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:51:32 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:51:32 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:51:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:51:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:51:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:51:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:51:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:37 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068682.147029, 2ffdcd8b-ac91-4686-82a6-79da99ddb253 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:51:37 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] VM Stopped (Lifecycle Event)
Aug 26 16:51:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9159852e-5820-4fc6-9fc3-49b243225811 None None] [instance: 2ffdcd8b-ac91-4686-82a6-79da99ddb253] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:51:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:37 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:51:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:51:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:51:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:51:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:51:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:51:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "520302ac-ba6b-4954-9acf-827b9e070fd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:51:55 user nova-compute[73627]: INFO nova.compute.claims [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Claim successful on node user
Aug 26 16:51:55 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:51:55 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:51:55 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG nova.policy [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3725a470efe84258825ac4db497f6761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1550b44802843dca4d2f8ad38adbc12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:51:55 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Creating image(s)
Aug 26 16:51:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "/opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "/opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "/opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.178s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk 1073741824" returned: 0 in 0.062s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Successfully created port: 74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Checking if we can resize image /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Cannot resize image /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Ensure instance console log exists: /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Successfully updated port: 74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "refresh_cache-520302ac-ba6b-4954-9acf-827b9e070fd7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquired lock "refresh_cache-520302ac-ba6b-4954-9acf-827b9e070fd7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-6ec3fdc4-fe0a-4db7-8095-09f427902919 req-161f8291-2185-43bb-89ee-8e5e02ac1ae2 service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Received event network-changed-74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.compute.manager [req-6ec3fdc4-fe0a-4db7-8095-09f427902919 req-161f8291-2185-43bb-89ee-8e5e02ac1ae2 service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Refreshing instance network info cache due to event network-changed-74ac69f7-7544-491d-84f2-d14b929ef9ac. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6ec3fdc4-fe0a-4db7-8095-09f427902919 req-161f8291-2185-43bb-89ee-8e5e02ac1ae2 service nova] Acquiring lock "refresh_cache-520302ac-ba6b-4954-9acf-827b9e070fd7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.network.neutron [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Updating instance_info_cache with network_info: [{"id": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "address": "fa:16:3e:6f:38:22", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ac69f7-75", "ovs_interfaceid": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Releasing lock "refresh_cache-520302ac-ba6b-4954-9acf-827b9e070fd7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Instance network_info: |[{"id": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "address": "fa:16:3e:6f:38:22", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ac69f7-75", "ovs_interfaceid": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6ec3fdc4-fe0a-4db7-8095-09f427902919 req-161f8291-2185-43bb-89ee-8e5e02ac1ae2 service nova] Acquired lock "refresh_cache-520302ac-ba6b-4954-9acf-827b9e070fd7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.network.neutron [req-6ec3fdc4-fe0a-4db7-8095-09f427902919 req-161f8291-2185-43bb-89ee-8e5e02ac1ae2 service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Refreshing network info cache for port 74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Start _get_guest_xml network_info=[{"id": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "address": "fa:16:3e:6f:38:22", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ac69f7-75", "ovs_interfaceid": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:51:57 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:51:57 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:51:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-186642349',display_name='tempest-VolumesSnapshotTestJSON-instance-186642349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-186642349',id=47,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrqpa/x2RjlO+jkV/hZdbbURrAlKNkK8HzoolMLTkiExj0MwIgQZtJoYPbWxN4B95+Jt6dxidwGcWZ5IcYLElB+pPbTq6x4QaycyfIAcVO7OEIhFyh5MUe9lyRw704KtQ==',key_name='tempest-keypair-66874122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1550b44802843dca4d2f8ad38adbc12',ramdisk_id='',reservation_id='r-wuil2lr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-351265767',owner_user_name='tempest-VolumesSnapshotTestJSON-351265767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:51:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3725a470efe84258825ac4db497f6761',uuid=520302ac-ba6b-4954-9acf-827b9e070fd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "address": "fa:16:3e:6f:38:22", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ac69f7-75", "ovs_interfaceid": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converting VIF {"id": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "address": "fa:16:3e:6f:38:22", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ac69f7-75", "ovs_interfaceid": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:38:22,bridge_name='br-int',has_traffic_filtering=True,id=74ac69f7-7544-491d-84f2-d14b929ef9ac,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ac69f7-75') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lazy-loading 'pci_devices' on Instance uuid 520302ac-ba6b-4954-9acf-827b9e070fd7 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:51:57 user nova-compute[73627]:   <uuid>520302ac-ba6b-4954-9acf-827b9e070fd7</uuid>
Aug 26 16:51:57 user nova-compute[73627]:   <name>instance-0000002f</name>
Aug 26 16:51:57 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:51:57 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:51:57 user nova-compute[73627]:   <metadata>
Aug 26 16:51:57 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:51:57 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:51:57 user nova-compute[73627]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-186642349</nova:name>
Aug 26 16:51:57 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:51:57</nova:creationTime>
Aug 26 16:51:57 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:51:57 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:51:57 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:51:57 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:51:57 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:51:57 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:51:57 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:51:57 user nova-compute[73627]:       <nova:owner>
Aug 26 16:51:57 user nova-compute[73627]:         <nova:user uuid="3725a470efe84258825ac4db497f6761">tempest-VolumesSnapshotTestJSON-351265767-project-member</nova:user>
Aug 26 16:51:57 user nova-compute[73627]:         <nova:project uuid="d1550b44802843dca4d2f8ad38adbc12">tempest-VolumesSnapshotTestJSON-351265767</nova:project>
Aug 26 16:51:57 user nova-compute[73627]:       </nova:owner>
Aug 26 16:51:57 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:51:57 user nova-compute[73627]:       <nova:ports>
Aug 26 16:51:57 user nova-compute[73627]:         <nova:port uuid="74ac69f7-7544-491d-84f2-d14b929ef9ac">
Aug 26 16:51:57 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 16:51:57 user nova-compute[73627]:         </nova:port>
Aug 26 16:51:57 user nova-compute[73627]:       </nova:ports>
Aug 26 16:51:57 user nova-compute[73627]:     </nova:instance>
Aug 26 16:51:57 user nova-compute[73627]:   </metadata>
Aug 26 16:51:57 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:51:57 user nova-compute[73627]:     <system>
Aug 26 16:51:57 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:51:57 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:51:57 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:51:57 user nova-compute[73627]:       <entry name="serial">520302ac-ba6b-4954-9acf-827b9e070fd7</entry>
Aug 26 16:51:57 user nova-compute[73627]:       <entry name="uuid">520302ac-ba6b-4954-9acf-827b9e070fd7</entry>
Aug 26 16:51:57 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:51:57 user nova-compute[73627]:     </system>
Aug 26 16:51:57 user nova-compute[73627]:   </sysinfo>
Aug 26 16:51:57 user nova-compute[73627]:   <os>
Aug 26 16:51:57 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:51:57 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:51:57 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:51:57 user nova-compute[73627]:   </os>
Aug 26 16:51:57 user nova-compute[73627]:   <features>
Aug 26 16:51:57 user nova-compute[73627]:     <acpi/>
Aug 26 16:51:57 user nova-compute[73627]:     <apic/>
Aug 26 16:51:57 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:51:57 user nova-compute[73627]:   </features>
Aug 26 16:51:57 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:51:57 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:51:57 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:51:57 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:51:57 user nova-compute[73627]:   </clock>
Aug 26 16:51:57 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:51:57 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:51:57 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:51:57 user nova-compute[73627]:   </cpu>
Aug 26 16:51:57 user nova-compute[73627]:   <devices>
Aug 26 16:51:57 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:51:57 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:51:57 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk"/>
Aug 26 16:51:57 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:51:57 user nova-compute[73627]:     </disk>
Aug 26 16:51:57 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:51:57 user nova-compute[73627]:       <mac address="fa:16:3e:6f:38:22"/>
Aug 26 16:51:57 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:51:57 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:51:57 user nova-compute[73627]:       <target dev="tap74ac69f7-75"/>
Aug 26 16:51:57 user nova-compute[73627]:     </interface>
Aug 26 16:51:57 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:51:57 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/console.log" append="off"/>
Aug 26 16:51:57 user nova-compute[73627]:     </serial>
Aug 26 16:51:57 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:51:57 user nova-compute[73627]:     <video>
Aug 26 16:51:57 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:51:57 user nova-compute[73627]:     </video>
Aug 26 16:51:57 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:51:57 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:51:57 user nova-compute[73627]:     </rng>
Aug 26 16:51:57 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:51:57 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:51:57 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:51:57 user nova-compute[73627]:     </memballoon>
Aug 26 16:51:57 user nova-compute[73627]:   </devices>
Aug 26 16:51:57 user nova-compute[73627]: </domain>
Aug 26 16:51:57 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:51:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-186642349',display_name='tempest-VolumesSnapshotTestJSON-instance-186642349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-186642349',id=47,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrqpa/x2RjlO+jkV/hZdbbURrAlKNkK8HzoolMLTkiExj0MwIgQZtJoYPbWxN4B95+Jt6dxidwGcWZ5IcYLElB+pPbTq6x4QaycyfIAcVO7OEIhFyh5MUe9lyRw704KtQ==',key_name='tempest-keypair-66874122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1550b44802843dca4d2f8ad38adbc12',ramdisk_id='',reservation_id='r-wuil2lr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-351265767',owner_user_name='tempest-VolumesSnapshotTestJSON-351265767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:51:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3725a470efe84258825ac4db497f6761',uuid=520302ac-ba6b-4954-9acf-827b9e070fd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "address": "fa:16:3e:6f:38:22", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ac69f7-75", "ovs_interfaceid": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converting VIF {"id": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "address": "fa:16:3e:6f:38:22", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ac69f7-75", "ovs_interfaceid": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:38:22,bridge_name='br-int',has_traffic_filtering=True,id=74ac69f7-7544-491d-84f2-d14b929ef9ac,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ac69f7-75') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG os_vif [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:38:22,bridge_name='br-int',has_traffic_filtering=True,id=74ac69f7-7544-491d-84f2-d14b929ef9ac,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ac69f7-75') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74ac69f7-75, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74ac69f7-75, col_values=(('external_ids', {'iface-id': '74ac69f7-7544-491d-84f2-d14b929ef9ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:38:22', 'vm-uuid': '520302ac-ba6b-4954-9acf-827b9e070fd7'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:57 user nova-compute[73627]: INFO os_vif [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:38:22,bridge_name='br-int',has_traffic_filtering=True,id=74ac69f7-7544-491d-84f2-d14b929ef9ac,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ac69f7-75')
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:51:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] No VIF found with MAC fa:16:3e:6f:38:22, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:51:58 user nova-compute[73627]: DEBUG nova.network.neutron [req-6ec3fdc4-fe0a-4db7-8095-09f427902919 req-161f8291-2185-43bb-89ee-8e5e02ac1ae2 service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Updated VIF entry in instance network info cache for port 74ac69f7-7544-491d-84f2-d14b929ef9ac. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:51:58 user nova-compute[73627]: DEBUG nova.network.neutron [req-6ec3fdc4-fe0a-4db7-8095-09f427902919 req-161f8291-2185-43bb-89ee-8e5e02ac1ae2 service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Updating instance_info_cache with network_info: [{"id": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "address": "fa:16:3e:6f:38:22", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ac69f7-75", "ovs_interfaceid": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:51:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-6ec3fdc4-fe0a-4db7-8095-09f427902919 req-161f8291-2185-43bb-89ee-8e5e02ac1ae2 service nova] Releasing lock "refresh_cache-520302ac-ba6b-4954-9acf-827b9e070fd7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:51:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-e8e812db-96b7-45a0-ae85-4d8dab909aa7 req-64541bbe-f411-4c6c-967f-f1fe1f6cd701 service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Received event network-vif-plugged-74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:51:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e8e812db-96b7-45a0-ae85-4d8dab909aa7 req-64541bbe-f411-4c6c-967f-f1fe1f6cd701 service nova] Acquiring lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:51:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e8e812db-96b7-45a0-ae85-4d8dab909aa7 req-64541bbe-f411-4c6c-967f-f1fe1f6cd701 service nova] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:51:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e8e812db-96b7-45a0-ae85-4d8dab909aa7 req-64541bbe-f411-4c6c-967f-f1fe1f6cd701 service nova] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:51:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-e8e812db-96b7-45a0-ae85-4d8dab909aa7 req-64541bbe-f411-4c6c-967f-f1fe1f6cd701 service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] No waiting events found dispatching network-vif-plugged-74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:51:59 user nova-compute[73627]: WARNING nova.compute.manager [req-e8e812db-96b7-45a0-ae85-4d8dab909aa7 req-64541bbe-f411-4c6c-967f-f1fe1f6cd701 service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Received unexpected event network-vif-plugged-74ac69f7-7544-491d-84f2-d14b929ef9ac for instance with vm_state building and task_state spawning.
Aug 26 16:51:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:51:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068721.1419866, 520302ac-ba6b-4954-9acf-827b9e070fd7 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:52:01 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] VM Resumed (Lifecycle Event)
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:52:01 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Instance spawned successfully.
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:01 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068721.147676, 520302ac-ba6b-4954-9acf-827b9e070fd7 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:52:01 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] VM Started (Lifecycle Event)
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:01 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:52:01 user nova-compute[73627]: INFO nova.compute.manager [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-29a2ac9e-9513-476c-b91d-3ebd25514c01 req-45582672-05b1-40da-8d81-ba721b9838fd service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Received event network-vif-plugged-74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-29a2ac9e-9513-476c-b91d-3ebd25514c01 req-45582672-05b1-40da-8d81-ba721b9838fd service nova] Acquiring lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-29a2ac9e-9513-476c-b91d-3ebd25514c01 req-45582672-05b1-40da-8d81-ba721b9838fd service nova] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-29a2ac9e-9513-476c-b91d-3ebd25514c01 req-45582672-05b1-40da-8d81-ba721b9838fd service nova] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-29a2ac9e-9513-476c-b91d-3ebd25514c01 req-45582672-05b1-40da-8d81-ba721b9838fd service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] No waiting events found dispatching network-vif-plugged-74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:52:01 user nova-compute[73627]: WARNING nova.compute.manager [req-29a2ac9e-9513-476c-b91d-3ebd25514c01 req-45582672-05b1-40da-8d81-ba721b9838fd service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Received unexpected event network-vif-plugged-74ac69f7-7544-491d-84f2-d14b929ef9ac for instance with vm_state building and task_state spawning.
Aug 26 16:52:01 user nova-compute[73627]: INFO nova.compute.manager [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Took 5.88 seconds to build instance.
Aug 26 16:52:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4768c50b-7be9-404c-95dd-12fb96c7c325 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.023s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-a5cbfe5c-e32e-4569-9dc4-39fe35fde94d req-dc978950-4f59-4f25-bfc9-24f1b8395b9a service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received event network-changed-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:52:17 user nova-compute[73627]: DEBUG nova.compute.manager [req-a5cbfe5c-e32e-4569-9dc4-39fe35fde94d req-dc978950-4f59-4f25-bfc9-24f1b8395b9a service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Refreshing instance network info cache due to event network-changed-9eb26d05-fe20-4127-93b0-2a707e0a8e6b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:52:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a5cbfe5c-e32e-4569-9dc4-39fe35fde94d req-dc978950-4f59-4f25-bfc9-24f1b8395b9a service nova] Acquiring lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:52:17 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a5cbfe5c-e32e-4569-9dc4-39fe35fde94d req-dc978950-4f59-4f25-bfc9-24f1b8395b9a service nova] Acquired lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:52:17 user nova-compute[73627]: DEBUG nova.network.neutron [req-a5cbfe5c-e32e-4569-9dc4-39fe35fde94d req-dc978950-4f59-4f25-bfc9-24f1b8395b9a service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Refreshing network info cache for port 9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:52:18 user nova-compute[73627]: DEBUG nova.network.neutron [req-a5cbfe5c-e32e-4569-9dc4-39fe35fde94d req-dc978950-4f59-4f25-bfc9-24f1b8395b9a service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Updated VIF entry in instance network info cache for port 9eb26d05-fe20-4127-93b0-2a707e0a8e6b. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:52:18 user nova-compute[73627]: DEBUG nova.network.neutron [req-a5cbfe5c-e32e-4569-9dc4-39fe35fde94d req-dc978950-4f59-4f25-bfc9-24f1b8395b9a service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Updating instance_info_cache with network_info: [{"id": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "address": "fa:16:3e:78:b0:b6", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb26d05-fe", "ovs_interfaceid": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:52:18 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a5cbfe5c-e32e-4569-9dc4-39fe35fde94d req-dc978950-4f59-4f25-bfc9-24f1b8395b9a service nova] Releasing lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG nova.objects.instance [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lazy-loading 'flavor' on Instance uuid f2a34fb0-f8ac-479c-88cf-c565fedc0315 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:19 user nova-compute[73627]: INFO nova.compute.manager [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Attaching volume d3d29fb4-579e-450c-9636-7a00c526fdd6 to /dev/vdb
Aug 26 16:52:19 user nova-compute[73627]: DEBUG os_brick.utils [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[815927b3-72a3-41a1-b55b-eb25c665c23a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b47190-79e9-451d-a102-6f4c437837a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2870918f-9b16-433c-8a27-037c6c54f7c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f931ee-610c-4a45-922c-2b69204855ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:52:19 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:52:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c03064-13cb-4506-a194-c3ba5931ac66]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG os_brick.utils [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:52:19 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Updating existing volume attachment record: f4e59b1d-b789-4334-8dd8-1f6c0fc0d521 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:52:20 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:52:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:52:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:24 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:52:25 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:52:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "985dd107-b637-40f6-9c11-abe58ac095bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "985dd107-b637-40f6-9c11-abe58ac095bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:26 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:52:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:26 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:52:26 user nova-compute[73627]: INFO nova.compute.claims [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Claim successful on node user
Aug 26 16:52:27 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:52:27 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:52:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG nova.policy [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c2828f3769d420b9d9caef2e6bc902f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4241157d52c848d49bed0589c2ec725e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:52:27 user nova-compute[73627]: INFO nova.virt.block_device [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Booting with volume 15f33b3b-6cfd-419d-9497-723c95217ad0 at /dev/vda
Aug 26 16:52:27 user nova-compute[73627]: DEBUG os_brick.utils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ff311c-1636-40b4-8ea9-f84db3292ee8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[970ce308-e1e9-4d42-b195-f6340c72c70c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83783dc-3ffa-4493-b7a1-f470a922c714]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc4ac4f-f25d-40a3-9f0b-e4947acbb20d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:52:27 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c786b7-838c-47ce-95b2-c6a7690274f7]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG os_brick.utils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Updating existing volume attachment record: 940a2ef6-3d1c-43da-a050-deaf80bdcaf5 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:52:27 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Successfully created port: b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:52:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Updating instance_info_cache with network_info: [{"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:52:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:52:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:52:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Successfully updated port: b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:52:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "refresh_cache-985dd107-b637-40f6-9c11-abe58ac095bd" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:52:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquired lock "refresh_cache-985dd107-b637-40f6-9c11-abe58ac095bd" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:52:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:52:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-e7c93107-1828-4aeb-a5cf-ec00c0486d83 req-e8ef0d2f-95f7-4b05-94f0-712d984a3d11 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Received event network-changed-b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:52:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-e7c93107-1828-4aeb-a5cf-ec00c0486d83 req-e8ef0d2f-95f7-4b05-94f0-712d984a3d11 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Refreshing instance network info cache due to event network-changed-b4552788-55e3-4102-ae3d-f6bd9b42f527. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:52:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e7c93107-1828-4aeb-a5cf-ec00c0486d83 req-e8ef0d2f-95f7-4b05-94f0-712d984a3d11 service nova] Acquiring lock "refresh_cache-985dd107-b637-40f6-9c11-abe58ac095bd" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:52:28 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG nova.network.neutron [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Updating instance_info_cache with network_info: [{"id": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "address": "fa:16:3e:73:cc:d2", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4552788-55", "ovs_interfaceid": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Releasing lock "refresh_cache-985dd107-b637-40f6-9c11-abe58ac095bd" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Instance network_info: |[{"id": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "address": "fa:16:3e:73:cc:d2", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4552788-55", "ovs_interfaceid": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e7c93107-1828-4aeb-a5cf-ec00c0486d83 req-e8ef0d2f-95f7-4b05-94f0-712d984a3d11 service nova] Acquired lock "refresh_cache-985dd107-b637-40f6-9c11-abe58ac095bd" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG nova.network.neutron [req-e7c93107-1828-4aeb-a5cf-ec00c0486d83 req-e8ef0d2f-95f7-4b05-94f0-712d984a3d11 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Refreshing network info cache for port b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG nova.network.neutron [req-e7c93107-1828-4aeb-a5cf-ec00c0486d83 req-e8ef0d2f-95f7-4b05-94f0-712d984a3d11 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Updated VIF entry in instance network info cache for port b4552788-55e3-4102-ae3d-f6bd9b42f527. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG nova.network.neutron [req-e7c93107-1828-4aeb-a5cf-ec00c0486d83 req-e8ef0d2f-95f7-4b05-94f0-712d984a3d11 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Updating instance_info_cache with network_info: [{"id": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "address": "fa:16:3e:73:cc:d2", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4552788-55", "ovs_interfaceid": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e7c93107-1828-4aeb-a5cf-ec00c0486d83 req-e8ef0d2f-95f7-4b05-94f0-712d984a3d11 service nova] Releasing lock "refresh_cache-985dd107-b637-40f6-9c11-abe58ac095bd" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:52:29 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVYlpKfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:52:30 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:52:30 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:52:30 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9384e0-8447-4acc-bf53-8848eaebb73d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:52:30 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f38710-e505-4e38-8228-4fd5925efe37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6] added
Aug 26 16:52:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e48d1f-e814-43f6-a8dc-65b9d1b255cd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4b405b-f71f-4317-a8e0-f290cba93ec0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVYlpKfZ {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVYlpKfZ" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d74be4-fbb2-48bf-8bf7-cfc492362522]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yVYlpKfZ'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[000ac6f9-3844-4eac-a936-3fd6e65d99a9]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe7dcf0-a06f-4ad2-924a-0fb6a4a7b4b1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:52:30 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:52:30 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:52:30 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 16:52:30 user nova-compute[73627]: 
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[361cfb9b-1a79-4868-947b-097f6ad2a453]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6, portal: 172.16.0.220,3260]
Aug 26 16:52:30 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6, portal: 172.16.0.220,3260] successful.
Aug 26 16:52:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab63e7d6-24c5-4663-88a7-558e1b3315a5]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e8061b-77e0-4ad2-9026-16a0ea4263ea]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 (non-flash)
Aug 26 16:52:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 (non-flash)
Aug 26 16:52:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb88892-1e3f-4b8a-a444-aa93b0b2d4ee]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVYlpKfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23565666564386136', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565666564386136', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG nova.objects.instance [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lazy-loading 'flavor' on Instance uuid f2a34fb0-f8ac-479c-88cf-c565fedc0315 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:52:31 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:52:31 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:52:31 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:52:31 user nova-compute[73627]:   <serial>d3d29fb4-579e-450c-9636-7a00c526fdd6</serial>
Aug 26 16:52:31 user nova-compute[73627]: </disk>
Aug 26 16:52:31 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:52:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:32 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:52:32 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8215MB free_disk=25.086292266845703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] No VIF found with MAC fa:16:3e:78:b0:b6, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 228134a5-86c8-47bc-a34d-e0aba6b33e08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance f2a34fb0-f8ac-479c-88cf-c565fedc0315 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance c047d4a9-c99b-4c02-b5de-2c654bdfc558 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 520302ac-ba6b-4954-9acf-827b9e070fd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 985dd107-b637-40f6-9c11-abe58ac095bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-57008741-fd79-4c80-bb24-a3f19c3c3d6b tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.054s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:52:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:52:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:52:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:52:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:34 user nova-compute[73627]: INFO nova.compute.manager [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Detaching volume d3d29fb4-579e-450c-9636-7a00c526fdd6
Aug 26 16:52:34 user nova-compute[73627]: INFO nova.virt.block_device [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Attempting to driver detach volume d3d29fb4-579e-450c-9636-7a00c526fdd6 from mountpoint /dev/vdb
Aug 26 16:52:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Attempting to detach device vdb from instance f2a34fb0-f8ac-479c-88cf-c565fedc0315 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:52:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:52:34 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:52:34 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:52:34 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:52:34 user nova-compute[73627]:   <serial>d3d29fb4-579e-450c-9636-7a00c526fdd6</serial>
Aug 26 16:52:34 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:52:34 user nova-compute[73627]: </disk>
Aug 26 16:52:34 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:52:34 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Successfully detached device vdb from instance f2a34fb0-f8ac-479c-88cf-c565fedc0315 from the persistent domain config.
Aug 26 16:52:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2a34fb0-f8ac-479c-88cf-c565fedc0315 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:52:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:52:34 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:52:34 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 16:52:34 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:52:34 user nova-compute[73627]:   <serial>d3d29fb4-579e-450c-9636-7a00c526fdd6</serial>
Aug 26 16:52:34 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:52:34 user nova-compute[73627]: </disk>
Aug 26 16:52:34 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693068755.1344364, f2a34fb0-f8ac-479c-88cf-c565fedc0315 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2a34fb0-f8ac-479c-88cf-c565fedc0315 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:52:35 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Successfully detached device vdb from instance f2a34fb0-f8ac-479c-88cf-c565fedc0315 from the live domain config.
Aug 26 16:52:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVYlpKfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:52:35 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2587bd3-1296-435d-a24f-0fda0643a9df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8e6c52-0451-43fd-8770-af2d2cb1d683]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 (non-flash)
Aug 26 16:52:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 (non-flash)
Aug 26 16:52:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e816d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddd1e38-2329-4b78-a326-cfbc5e6585cf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e24766-c200-4eb9-800a-4f62045cbe5a]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde9aed5-a885-4c71-8648-bdd60453f795]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.104s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd5992a-5aec-4330-8060-1f964f5cff6a]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[845450cd-5066-4812-a36b-7e6ff0c726ae]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6f7d07-2b1f-4e4d-97e1-67e219ff1656]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6, portal: 172.16.0.220,3260]
Aug 26 16:52:35 user nova-compute[73627]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6, portal: 172.16.0.220,3260] successful.
Aug 26 16:52:35 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3d29fb4-579e-450c-9636-7a00c526fdd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeae123-c6bb-4ab1-9f0b-5a8cea6baf84]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] <== disconnect_volume: return (327ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:52:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:52:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:36 user nova-compute[73627]: DEBUG nova.objects.instance [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lazy-loading 'flavor' on Instance uuid f2a34fb0-f8ac-479c-88cf-c565fedc0315 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:52:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-daa491f2-6d0a-4442-bf66-689a1d80b0a0 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.773s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:52:38 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Creating image(s)
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Ensure instance console log exists: /opt/stack/data/nova/instances/985dd107-b637-40f6-9c11-abe58ac095bd/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Start _get_guest_xml network_info=[{"id": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "address": "fa:16:3e:73:cc:d2", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4552788-55", "ovs_interfaceid": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJRemWqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '985dd107-b637-40f6-9c11-abe58ac095bd', 'attached_at': '', 'detached_at': '', 'volume_id': '15f33b3b-6cfd-419d-9497-723c95217ad0', 'serial': '15f33b3b-6cfd-419d-9497-723c95217ad0'}, 'guest_format': None, 'attachment_id': '940a2ef6-3d1c-43da-a050-deaf80bdcaf5', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:52:38 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:52:38 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJRemWqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:52:38 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:52:38 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:52:38 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9f50ed-c193-4d33-b8fc-6c2da6ae76fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:52:38 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[816b85e9-0aeb-4cf2-b0f0-b3370a49f2f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0] added
Aug 26 16:52:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e080ab1f-ea4d-48cd-978f-bfb814ed72b0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d8625e-da75-460e-8f0c-a70ef734708d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJRemWqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJRemWqn" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15893a3-a951-41df-aa1e-51c9dfcc80a3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VJRemWqn'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[709e23da-926c-4785-a583-8f229f7c4377]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1f8718-543f-4f12-9ed6-fe18438d828b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:52:38 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:52:38 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:52:38 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 16:52:38 user nova-compute[73627]: 
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9342e55f-bacd-4791-b83c-3c2fd562ec7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260]
Aug 26 16:52:38 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260] successful.
Aug 26 16:52:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eca001-02da-4fd4-8782-568c1df62cee]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[850cfe9d-0ac8-4d1a-9c37-6b4389840d77]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:52:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:52:38 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbe7f58-da00-4bac-8091-45156e970fbf]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:52:38 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJRemWqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23637393539333931', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637393539333931', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:52:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1803150497',display_name='tempest-TestVolumeBootPattern-server-1803150497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1803150497',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFG7wB0UmOp8pWohUGUbew4A+9iiAIJnhdwGUEPyEdu1HQG05W/Bj3k7KHv07ehiBlxAKsBzl/ZdUB+KCGvVAg+9lfOQY879dDx/zV5sgWDmgodrMTlkSVXktIY1G/3Q==',key_name='tempest-TestVolumeBootPattern-977974239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-h6b2lndz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:52:27Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=985dd107-b637-40f6-9c11-abe58ac095bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "address": "fa:16:3e:73:cc:d2", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4552788-55", "ovs_interfaceid": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "address": "fa:16:3e:73:cc:d2", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4552788-55", "ovs_interfaceid": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=b4552788-55e3-4102-ae3d-f6bd9b42f527,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4552788-55') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG nova.objects.instance [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'pci_devices' on Instance uuid 985dd107-b637-40f6-9c11-abe58ac095bd {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:52:39 user nova-compute[73627]:   <uuid>985dd107-b637-40f6-9c11-abe58ac095bd</uuid>
Aug 26 16:52:39 user nova-compute[73627]:   <name>instance-00000030</name>
Aug 26 16:52:39 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:52:39 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:52:39 user nova-compute[73627]:   <metadata>
Aug 26 16:52:39 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:52:39 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:52:39 user nova-compute[73627]:       <nova:name>tempest-TestVolumeBootPattern-server-1803150497</nova:name>
Aug 26 16:52:39 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:52:38</nova:creationTime>
Aug 26 16:52:39 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:52:39 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:52:39 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:52:39 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:52:39 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:52:39 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:52:39 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:52:39 user nova-compute[73627]:       <nova:owner>
Aug 26 16:52:39 user nova-compute[73627]:         <nova:user uuid="1c2828f3769d420b9d9caef2e6bc902f">tempest-TestVolumeBootPattern-1705344746-project-member</nova:user>
Aug 26 16:52:39 user nova-compute[73627]:         <nova:project uuid="4241157d52c848d49bed0589c2ec725e">tempest-TestVolumeBootPattern-1705344746</nova:project>
Aug 26 16:52:39 user nova-compute[73627]:       </nova:owner>
Aug 26 16:52:39 user nova-compute[73627]:       <nova:ports>
Aug 26 16:52:39 user nova-compute[73627]:         <nova:port uuid="b4552788-55e3-4102-ae3d-f6bd9b42f527">
Aug 26 16:52:39 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 16:52:39 user nova-compute[73627]:         </nova:port>
Aug 26 16:52:39 user nova-compute[73627]:       </nova:ports>
Aug 26 16:52:39 user nova-compute[73627]:     </nova:instance>
Aug 26 16:52:39 user nova-compute[73627]:   </metadata>
Aug 26 16:52:39 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:52:39 user nova-compute[73627]:     <system>
Aug 26 16:52:39 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:52:39 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:52:39 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:52:39 user nova-compute[73627]:       <entry name="serial">985dd107-b637-40f6-9c11-abe58ac095bd</entry>
Aug 26 16:52:39 user nova-compute[73627]:       <entry name="uuid">985dd107-b637-40f6-9c11-abe58ac095bd</entry>
Aug 26 16:52:39 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:52:39 user nova-compute[73627]:     </system>
Aug 26 16:52:39 user nova-compute[73627]:   </sysinfo>
Aug 26 16:52:39 user nova-compute[73627]:   <os>
Aug 26 16:52:39 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:52:39 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:52:39 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:52:39 user nova-compute[73627]:   </os>
Aug 26 16:52:39 user nova-compute[73627]:   <features>
Aug 26 16:52:39 user nova-compute[73627]:     <acpi/>
Aug 26 16:52:39 user nova-compute[73627]:     <apic/>
Aug 26 16:52:39 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:52:39 user nova-compute[73627]:   </features>
Aug 26 16:52:39 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:52:39 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:52:39 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:52:39 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:52:39 user nova-compute[73627]:   </clock>
Aug 26 16:52:39 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:52:39 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:52:39 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:52:39 user nova-compute[73627]:   </cpu>
Aug 26 16:52:39 user nova-compute[73627]:   <devices>
Aug 26 16:52:39 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:52:39 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:52:39 user nova-compute[73627]:       <source dev="/dev/sdb"/>
Aug 26 16:52:39 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:52:39 user nova-compute[73627]:       <serial>15f33b3b-6cfd-419d-9497-723c95217ad0</serial>
Aug 26 16:52:39 user nova-compute[73627]:     </disk>
Aug 26 16:52:39 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:52:39 user nova-compute[73627]:       <mac address="fa:16:3e:73:cc:d2"/>
Aug 26 16:52:39 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:52:39 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:52:39 user nova-compute[73627]:       <target dev="tapb4552788-55"/>
Aug 26 16:52:39 user nova-compute[73627]:     </interface>
Aug 26 16:52:39 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:52:39 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/985dd107-b637-40f6-9c11-abe58ac095bd/console.log" append="off"/>
Aug 26 16:52:39 user nova-compute[73627]:     </serial>
Aug 26 16:52:39 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:52:39 user nova-compute[73627]:     <video>
Aug 26 16:52:39 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:52:39 user nova-compute[73627]:     </video>
Aug 26 16:52:39 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:52:39 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:52:39 user nova-compute[73627]:     </rng>
Aug 26 16:52:39 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:52:39 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:52:39 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:52:39 user nova-compute[73627]:     </memballoon>
Aug 26 16:52:39 user nova-compute[73627]:   </devices>
Aug 26 16:52:39 user nova-compute[73627]: </domain>
Aug 26 16:52:39 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:52:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1803150497',display_name='tempest-TestVolumeBootPattern-server-1803150497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1803150497',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFG7wB0UmOp8pWohUGUbew4A+9iiAIJnhdwGUEPyEdu1HQG05W/Bj3k7KHv07ehiBlxAKsBzl/ZdUB+KCGvVAg+9lfOQY879dDx/zV5sgWDmgodrMTlkSVXktIY1G/3Q==',key_name='tempest-TestVolumeBootPattern-977974239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-h6b2lndz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:52:27Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=985dd107-b637-40f6-9c11-abe58ac095bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "address": "fa:16:3e:73:cc:d2", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4552788-55", "ovs_interfaceid": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "address": "fa:16:3e:73:cc:d2", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4552788-55", "ovs_interfaceid": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=b4552788-55e3-4102-ae3d-f6bd9b42f527,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4552788-55') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG os_vif [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=b4552788-55e3-4102-ae3d-f6bd9b42f527,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4552788-55') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4552788-55, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4552788-55, col_values=(('external_ids', {'iface-id': 'b4552788-55e3-4102-ae3d-f6bd9b42f527', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:cc:d2', 'vm-uuid': '985dd107-b637-40f6-9c11-abe58ac095bd'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:39 user nova-compute[73627]: INFO os_vif [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=b4552788-55e3-4102-ae3d-f6bd9b42f527,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4552788-55')
Aug 26 16:52:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:52:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No VIF found with MAC fa:16:3e:73:cc:d2, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:52:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-903bc946-205e-4e12-a1c2-8788ff16a3dc req-98a055a0-2da2-4347-822e-3507daedf27d service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Received event network-vif-plugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:52:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-903bc946-205e-4e12-a1c2-8788ff16a3dc req-98a055a0-2da2-4347-822e-3507daedf27d service nova] Acquiring lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-903bc946-205e-4e12-a1c2-8788ff16a3dc req-98a055a0-2da2-4347-822e-3507daedf27d service nova] Lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-903bc946-205e-4e12-a1c2-8788ff16a3dc req-98a055a0-2da2-4347-822e-3507daedf27d service nova] Lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:41 user nova-compute[73627]: DEBUG nova.compute.manager [req-903bc946-205e-4e12-a1c2-8788ff16a3dc req-98a055a0-2da2-4347-822e-3507daedf27d service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] No waiting events found dispatching network-vif-plugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:52:41 user nova-compute[73627]: WARNING nova.compute.manager [req-903bc946-205e-4e12-a1c2-8788ff16a3dc req-98a055a0-2da2-4347-822e-3507daedf27d service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Received unexpected event network-vif-plugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 for instance with vm_state building and task_state spawning.
Aug 26 16:52:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068763.1663046, 985dd107-b637-40f6-9c11-abe58ac095bd => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:52:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] VM Resumed (Lifecycle Event)
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:52:43 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Instance spawned successfully.
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-d48b65e3-dc2d-40de-91f7-bc7a0ab613c4 req-bc5b5fa7-7e26-4eed-a3fe-502fd6f2ab54 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Received event network-vif-plugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d48b65e3-dc2d-40de-91f7-bc7a0ab613c4 req-bc5b5fa7-7e26-4eed-a3fe-502fd6f2ab54 service nova] Acquiring lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d48b65e3-dc2d-40de-91f7-bc7a0ab613c4 req-bc5b5fa7-7e26-4eed-a3fe-502fd6f2ab54 service nova] Lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d48b65e3-dc2d-40de-91f7-bc7a0ab613c4 req-bc5b5fa7-7e26-4eed-a3fe-502fd6f2ab54 service nova] Lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.compute.manager [req-d48b65e3-dc2d-40de-91f7-bc7a0ab613c4 req-bc5b5fa7-7e26-4eed-a3fe-502fd6f2ab54 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] No waiting events found dispatching network-vif-plugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:52:43 user nova-compute[73627]: WARNING nova.compute.manager [req-d48b65e3-dc2d-40de-91f7-bc7a0ab613c4 req-bc5b5fa7-7e26-4eed-a3fe-502fd6f2ab54 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Received unexpected event network-vif-plugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 for instance with vm_state building and task_state spawning.
Aug 26 16:52:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068763.168386, 985dd107-b637-40f6-9c11-abe58ac095bd => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:52:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] VM Started (Lifecycle Event)
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:52:43 user nova-compute[73627]: INFO nova.compute.manager [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 26 16:52:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:52:43 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:52:43 user nova-compute[73627]: INFO nova.compute.manager [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Took 16.62 seconds to build instance.
Aug 26 16:52:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a24cbe69-2732-42b1-a331-42e996de7029 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "985dd107-b637-40f6-9c11-abe58ac095bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.713s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:51 user nova-compute[73627]: INFO nova.compute.manager [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Terminating instance
Aug 26 16:52:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-534829ff-648f-4301-90df-65c44406745a req-98847443-84a8-4efd-93b0-11d1e939f913 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received event network-vif-unplugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-534829ff-648f-4301-90df-65c44406745a req-98847443-84a8-4efd-93b0-11d1e939f913 service nova] Acquiring lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-534829ff-648f-4301-90df-65c44406745a req-98847443-84a8-4efd-93b0-11d1e939f913 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-534829ff-648f-4301-90df-65c44406745a req-98847443-84a8-4efd-93b0-11d1e939f913 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-534829ff-648f-4301-90df-65c44406745a req-98847443-84a8-4efd-93b0-11d1e939f913 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] No waiting events found dispatching network-vif-unplugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG nova.compute.manager [req-534829ff-648f-4301-90df-65c44406745a req-98847443-84a8-4efd-93b0-11d1e939f913 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received event network-vif-unplugged-c894d56a-baa6-44fc-9a53-45c90fa5195d for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:52 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Instance destroyed successfully.
Aug 26 16:52:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG nova.objects.instance [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lazy-loading 'resources' on Instance uuid c047d4a9-c99b-4c02-b5de-2c654bdfc558 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1555536829',display_name='tempest-ServersNegativeTestJSON-server-1555536829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1555536829',id=46,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ddffe7ec6b14545bd7f8d741be7c4a2',ramdisk_id='',reservation_id='r-h8i2ykck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2065687253',owner_user_name='tempest-ServersNegativeTestJSON-2065687253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:51:08Z,user_data=None,user_id='a771feb2513a4866a1209f1abf754e8c',uuid=c047d4a9-c99b-4c02-b5de-2c654bdfc558,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "address": "fa:16:3e:15:f2:97", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc894d56a-ba", "ovs_interfaceid": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converting VIF {"id": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "address": "fa:16:3e:15:f2:97", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc894d56a-ba", "ovs_interfaceid": "c894d56a-baa6-44fc-9a53-45c90fa5195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:f2:97,bridge_name='br-int',has_traffic_filtering=True,id=c894d56a-baa6-44fc-9a53-45c90fa5195d,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc894d56a-ba') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG os_vif [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f2:97,bridge_name='br-int',has_traffic_filtering=True,id=c894d56a-baa6-44fc-9a53-45c90fa5195d,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc894d56a-ba') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc894d56a-ba, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:52:52 user nova-compute[73627]: INFO os_vif [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f2:97,bridge_name='br-int',has_traffic_filtering=True,id=c894d56a-baa6-44fc-9a53-45c90fa5195d,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc894d56a-ba')
Aug 26 16:52:52 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Deleting instance files /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558_del
Aug 26 16:52:52 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Deletion of /opt/stack/data/nova/instances/c047d4a9-c99b-4c02-b5de-2c654bdfc558_del complete
Aug 26 16:52:52 user nova-compute[73627]: INFO nova.compute.manager [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 26 16:52:52 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:52:53 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Took 0.80 seconds to deallocate network for instance.
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:53 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Deleted allocations for instance c047d4a9-c99b-4c02-b5de-2c654bdfc558
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29a3f6bb-542b-404f-a4d0-cec24ff20dc8 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.887s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Acquiring lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] No waiting events found dispatching network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:52:53 user nova-compute[73627]: WARNING nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received unexpected event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d for instance with vm_state deleted and task_state None.
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Acquiring lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] No waiting events found dispatching network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:52:53 user nova-compute[73627]: WARNING nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received unexpected event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d for instance with vm_state deleted and task_state None.
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Acquiring lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] No waiting events found dispatching network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:52:53 user nova-compute[73627]: WARNING nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received unexpected event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d for instance with vm_state deleted and task_state None.
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Acquiring lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] Lock "c047d4a9-c99b-4c02-b5de-2c654bdfc558-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] No waiting events found dispatching network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:52:53 user nova-compute[73627]: WARNING nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received unexpected event network-vif-plugged-c894d56a-baa6-44fc-9a53-45c90fa5195d for instance with vm_state deleted and task_state None.
Aug 26 16:52:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-8823c3ee-b06e-4680-8fac-941c78d7cad8 req-1790e6ed-c723-426e-872b-af765d639230 service nova] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Received event network-vif-deleted-c894d56a-baa6-44fc-9a53-45c90fa5195d {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:52:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:07 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068772.1760304, c047d4a9-c99b-4c02-b5de-2c654bdfc558 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:53:07 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] VM Stopped (Lifecycle Event)
Aug 26 16:53:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9e4b1440-715a-4901-b41a-3213a50f4e59 None None] [instance: c047d4a9-c99b-4c02-b5de-2c654bdfc558] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:53:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:53:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:53:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:53:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:53:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:53:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:21 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:53:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:53:22 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-a139dcc6-2e69-4ae5-be21-a9a65032a982 req-53b1a9a6-9a9e-45ef-93b2-498898fb3c67 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received event network-changed-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-a139dcc6-2e69-4ae5-be21-a9a65032a982 req-53b1a9a6-9a9e-45ef-93b2-498898fb3c67 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Refreshing instance network info cache due to event network-changed-9eb26d05-fe20-4127-93b0-2a707e0a8e6b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a139dcc6-2e69-4ae5-be21-a9a65032a982 req-53b1a9a6-9a9e-45ef-93b2-498898fb3c67 service nova] Acquiring lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a139dcc6-2e69-4ae5-be21-a9a65032a982 req-53b1a9a6-9a9e-45ef-93b2-498898fb3c67 service nova] Acquired lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG nova.network.neutron [req-a139dcc6-2e69-4ae5-be21-a9a65032a982 req-53b1a9a6-9a9e-45ef-93b2-498898fb3c67 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Refreshing network info cache for port 9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:53:25 user nova-compute[73627]: INFO nova.compute.manager [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Terminating instance
Aug 26 16:53:25 user nova-compute[73627]: DEBUG nova.compute.manager [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Instance destroyed successfully.
Aug 26 16:53:26 user nova-compute[73627]: DEBUG nova.objects.instance [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lazy-loading 'resources' on Instance uuid f2a34fb0-f8ac-479c-88cf-c565fedc0315 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-47338849',display_name='tempest-TestStampPattern-server-47338849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-47338849',id=45,image_ref='76cd1f3e-cd84-40f4-8024-e54f9e22656c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClm4sbJTbQecTTto7JpLosQLvUWuSSwBPYQ/9eVAIKa4x5C24J3npTbB1xGl2BdK0pMwRzKGeyIQQpilDlIlaAntYzFvMNplr4IkHrgY6/OLLZmaIAY+eAS/bXWwYiwgg==',key_name='tempest-TestStampPattern-599218896',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b4b851aec5746a68bb6cd57285b133a',ramdisk_id='',reservation_id='r-sll1f41d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='faa17ff2-089a-4499-bde5-3b9314b3c4a7',image_min_disk='1',image_min_ram='0',image_owner_id='2b4b851aec5746a68bb6cd57285b133a',image_owner_project_name='tempest-TestStampPattern-1807109610',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1807109610-project-member',image_user_id='23b0873451304eefb3eb0f8f01727182',owner_project_name='tempest-TestStampPattern-1807109610',owner_user_name='tempest-TestStampPattern-1807109610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:50:35Z,user_data=None,user_id='23b0873451304eefb3eb0f8f01727182',uuid=f2a34fb0-f8ac-479c-88cf-c565fedc0315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "address": "fa:16:3e:78:b0:b6", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb26d05-fe", "ovs_interfaceid": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converting VIF {"id": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "address": "fa:16:3e:78:b0:b6", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb26d05-fe", "ovs_interfaceid": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:b0:b6,bridge_name='br-int',has_traffic_filtering=True,id=9eb26d05-fe20-4127-93b0-2a707e0a8e6b,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb26d05-fe') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG os_vif [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:b0:b6,bridge_name='br-int',has_traffic_filtering=True,id=9eb26d05-fe20-4127-93b0-2a707e0a8e6b,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb26d05-fe') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9eb26d05-fe, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:26 user nova-compute[73627]: INFO os_vif [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:b0:b6,bridge_name='br-int',has_traffic_filtering=True,id=9eb26d05-fe20-4127-93b0-2a707e0a8e6b,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eb26d05-fe')
Aug 26 16:53:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Deleting instance files /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315_del
Aug 26 16:53:26 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Deletion of /opt/stack/data/nova/instances/f2a34fb0-f8ac-479c-88cf-c565fedc0315_del complete
Aug 26 16:53:26 user nova-compute[73627]: INFO nova.compute.manager [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 26 16:53:26 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG nova.network.neutron [req-a139dcc6-2e69-4ae5-be21-a9a65032a982 req-53b1a9a6-9a9e-45ef-93b2-498898fb3c67 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Updated VIF entry in instance network info cache for port 9eb26d05-fe20-4127-93b0-2a707e0a8e6b. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG nova.network.neutron [req-a139dcc6-2e69-4ae5-be21-a9a65032a982 req-53b1a9a6-9a9e-45ef-93b2-498898fb3c67 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Updating instance_info_cache with network_info: [{"id": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "address": "fa:16:3e:78:b0:b6", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eb26d05-fe", "ovs_interfaceid": "9eb26d05-fe20-4127-93b0-2a707e0a8e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a139dcc6-2e69-4ae5-be21-a9a65032a982 req-53b1a9a6-9a9e-45ef-93b2-498898fb3c67 service nova] Releasing lock "refresh_cache-f2a34fb0-f8ac-479c-88cf-c565fedc0315" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:53:26 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Took 0.51 seconds to deallocate network for instance.
Aug 26 16:53:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-8984e465-3147-4839-b0ce-03830b9475b3 req-cfc8d7bd-89cb-4238-ad22-1062a555e681 service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received event network-vif-deleted-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:53:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:53:27 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Deleted allocations for instance f2a34fb0-f8ac-479c-88cf-c565fedc0315
Aug 26 16:53:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2e6d715b-7f9e-435e-b0ad-0934b510498c tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.742s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received event network-vif-unplugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] Acquiring lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] No waiting events found dispatching network-vif-unplugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:53:27 user nova-compute[73627]: WARNING nova.compute.manager [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received unexpected event network-vif-unplugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b for instance with vm_state deleted and task_state None.
Aug 26 16:53:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received event network-vif-plugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] Acquiring lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] Lock "f2a34fb0-f8ac-479c-88cf-c565fedc0315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:53:27 user nova-compute[73627]: DEBUG nova.compute.manager [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] No waiting events found dispatching network-vif-plugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:53:27 user nova-compute[73627]: WARNING nova.compute.manager [req-4b1311bc-32ba-4b4f-8d6e-aaf126aa3ba7 req-12a112da-c7eb-4562-b41e-96f74c29e11f service nova] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Received unexpected event network-vif-plugged-9eb26d05-fe20-4127-93b0-2a707e0a8e6b for instance with vm_state deleted and task_state None.
Aug 26 16:53:29 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:53:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:53:29 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 16:53:30 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:53:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:53:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:31 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:53:31 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:53:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:53:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:53:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:53:31 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:53:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:53:31 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:53:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:53:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:53:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:53:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:53:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:53:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:53:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:53:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:53:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:53:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:53:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:53:33 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:53:33 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:53:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8294MB free_disk=25.105480194091797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance faa17ff2-089a-4499-bde5-3b9314b3c4a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 228134a5-86c8-47bc-a34d-e0aba6b33e08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 520302ac-ba6b-4954-9acf-827b9e070fd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 985dd107-b637-40f6-9c11-abe58ac095bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:53:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:53:35 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:53:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:53:41 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068806.2804403, f2a34fb0-f8ac-479c-88cf-c565fedc0315 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:53:41 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] VM Stopped (Lifecycle Event)
Aug 26 16:53:41 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5b2a59fc-6167-441d-b649-fbedd700e994 None None] [instance: f2a34fb0-f8ac-479c-88cf-c565fedc0315] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:53:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:53:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:53:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:53:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:53:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:42 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:53:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-dfac1a11-680d-4108-9bb9-2381f5f2a5bd req-c1f206d1-992d-4bab-8a1e-a573c126e73b service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Received event network-changed-74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:53:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-dfac1a11-680d-4108-9bb9-2381f5f2a5bd req-c1f206d1-992d-4bab-8a1e-a573c126e73b service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Refreshing instance network info cache due to event network-changed-74ac69f7-7544-491d-84f2-d14b929ef9ac. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:53:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dfac1a11-680d-4108-9bb9-2381f5f2a5bd req-c1f206d1-992d-4bab-8a1e-a573c126e73b service nova] Acquiring lock "refresh_cache-520302ac-ba6b-4954-9acf-827b9e070fd7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:53:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dfac1a11-680d-4108-9bb9-2381f5f2a5bd req-c1f206d1-992d-4bab-8a1e-a573c126e73b service nova] Acquired lock "refresh_cache-520302ac-ba6b-4954-9acf-827b9e070fd7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:53:46 user nova-compute[73627]: DEBUG nova.network.neutron [req-dfac1a11-680d-4108-9bb9-2381f5f2a5bd req-c1f206d1-992d-4bab-8a1e-a573c126e73b service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Refreshing network info cache for port 74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:53:47 user nova-compute[73627]: DEBUG nova.network.neutron [req-dfac1a11-680d-4108-9bb9-2381f5f2a5bd req-c1f206d1-992d-4bab-8a1e-a573c126e73b service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Updated VIF entry in instance network info cache for port 74ac69f7-7544-491d-84f2-d14b929ef9ac. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:53:47 user nova-compute[73627]: DEBUG nova.network.neutron [req-dfac1a11-680d-4108-9bb9-2381f5f2a5bd req-c1f206d1-992d-4bab-8a1e-a573c126e73b service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Updating instance_info_cache with network_info: [{"id": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "address": "fa:16:3e:6f:38:22", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ac69f7-75", "ovs_interfaceid": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:53:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-dfac1a11-680d-4108-9bb9-2381f5f2a5bd req-c1f206d1-992d-4bab-8a1e-a573c126e73b service nova] Releasing lock "refresh_cache-520302ac-ba6b-4954-9acf-827b9e070fd7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:53:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "520302ac-ba6b-4954-9acf-827b9e070fd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:53:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:53:47 user nova-compute[73627]: DEBUG nova.objects.instance [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lazy-loading 'flavor' on Instance uuid 520302ac-ba6b-4954-9acf-827b9e070fd7 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:53:47 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Ignoring supplied device name: /dev/vdb
Aug 26 16:53:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "520302ac-ba6b-4954-9acf-827b9e070fd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:53:48 user nova-compute[73627]: INFO nova.compute.manager [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Attaching volume 14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 to /dev/vdb
Aug 26 16:53:48 user nova-compute[73627]: DEBUG os_brick.utils [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bba5fd-8558-4cea-a056-5fb4f122515c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dca21c0-8ab4-4d26-900c-6cad35cc6632]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07fc612-c5a2-482c-8aff-881bcf69ed3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e42251c-cd52-4579-a8f5-a87c5829b584]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:53:48 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:53:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11f6007-9731-4252-9685-1b0e6d5e94db]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG os_brick.utils [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:53:48 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Updating existing volume attachment record: d6fb9dad-31ae-4e8e-b1e3-6d6d7b1d4d7c {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:53:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:53:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiVOPFJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:54:05 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:54:05 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:54:05 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e0ba2a-e2a3-42f6-a0ac-f2ca3ea76bf3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:54:05 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fd43f2-7034-446b-ad4c-b1be410c186c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98] added
Aug 26 16:54:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4942042-65a1-4af2-8309-2321316c3fa0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eecf525-4805-4c71-bf76-a635026c6a45]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SiVOPFJK {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SiVOPFJK" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a00d76-10fe-4bda-b397-2499565990d8]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SiVOPFJK'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f33df9-ba5b-47a3-abc2-57cdd62ade9b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1437d86b-93a0-41d3-817b-2e8c0e1fdfb7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:54:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:54:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba70f9-e58d-4b27-a013-4eac5571b7ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98, portal: 172.16.0.220,3260]
Aug 26 16:54:05 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98, portal: 172.16.0.220,3260] successful.
Aug 26 16:54:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f5de9b-3c40-47dc-82f6-13b667d22c16]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cdf64d-acf6-4358-93b0-b6b36bb79aba]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:54:05 user nova-compute[73627]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 (non-flash)
Aug 26 16:54:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:54:05 user nova-compute[73627]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 (non-flash)
Aug 26 16:54:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee5ff15-2aee-4e0b-88c4-cfa2cd714b4b]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:54:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiVOPFJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:54:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:54:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:54:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:54:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:54:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:54:07 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26664653433613264', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:54:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664653433613264', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:54:07 user nova-compute[73627]: DEBUG nova.objects.instance [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lazy-loading 'flavor' on Instance uuid 520302ac-ba6b-4954-9acf-827b9e070fd7 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:54:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:54:07 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:54:07 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:54:07 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:54:07 user nova-compute[73627]:   <serial>14a7cb03-b3f4-437b-9b00-7b0ce3e57e98</serial>
Aug 26 16:54:07 user nova-compute[73627]: </disk>
Aug 26 16:54:07 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:54:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:54:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:54:07 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] No VIF found with MAC fa:16:3e:6f:38:22, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:54:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-29f7a3fe-039d-4fa2-9042-913ee5765bbf tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.522s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:54:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-1b8f14b7-1cbc-425a-bd9c-b42639abacd8 req-edc2d4dd-c9b6-4e45-9881-871db420ed44 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Received event network-changed-b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:54:19 user nova-compute[73627]: DEBUG nova.compute.manager [req-1b8f14b7-1cbc-425a-bd9c-b42639abacd8 req-edc2d4dd-c9b6-4e45-9881-871db420ed44 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Refreshing instance network info cache due to event network-changed-b4552788-55e3-4102-ae3d-f6bd9b42f527. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:54:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1b8f14b7-1cbc-425a-bd9c-b42639abacd8 req-edc2d4dd-c9b6-4e45-9881-871db420ed44 service nova] Acquiring lock "refresh_cache-985dd107-b637-40f6-9c11-abe58ac095bd" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:54:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1b8f14b7-1cbc-425a-bd9c-b42639abacd8 req-edc2d4dd-c9b6-4e45-9881-871db420ed44 service nova] Acquired lock "refresh_cache-985dd107-b637-40f6-9c11-abe58ac095bd" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:54:19 user nova-compute[73627]: DEBUG nova.network.neutron [req-1b8f14b7-1cbc-425a-bd9c-b42639abacd8 req-edc2d4dd-c9b6-4e45-9881-871db420ed44 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Refreshing network info cache for port b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:54:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "985dd107-b637-40f6-9c11-abe58ac095bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "985dd107-b637-40f6-9c11-abe58ac095bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:19 user nova-compute[73627]: INFO nova.compute.manager [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Terminating instance
Aug 26 16:54:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-1b8f14b7-1cbc-425a-bd9c-b42639abacd8 req-edc2d4dd-c9b6-4e45-9881-871db420ed44 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Updated VIF entry in instance network info cache for port b4552788-55e3-4102-ae3d-f6bd9b42f527. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-1b8f14b7-1cbc-425a-bd9c-b42639abacd8 req-edc2d4dd-c9b6-4e45-9881-871db420ed44 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Updating instance_info_cache with network_info: [{"id": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "address": "fa:16:3e:73:cc:d2", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4552788-55", "ovs_interfaceid": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-1b8f14b7-1cbc-425a-bd9c-b42639abacd8 req-edc2d4dd-c9b6-4e45-9881-871db420ed44 service nova] Releasing lock "refresh_cache-985dd107-b637-40f6-9c11-abe58ac095bd" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-f8f9e11f-191b-4954-9973-bc99a271a695 req-33e0003e-cb56-4233-b84a-089082e9cf33 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Received event network-vif-unplugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f8f9e11f-191b-4954-9973-bc99a271a695 req-33e0003e-cb56-4233-b84a-089082e9cf33 service nova] Acquiring lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f8f9e11f-191b-4954-9973-bc99a271a695 req-33e0003e-cb56-4233-b84a-089082e9cf33 service nova] Lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f8f9e11f-191b-4954-9973-bc99a271a695 req-33e0003e-cb56-4233-b84a-089082e9cf33 service nova] Lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-f8f9e11f-191b-4954-9973-bc99a271a695 req-33e0003e-cb56-4233-b84a-089082e9cf33 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] No waiting events found dispatching network-vif-unplugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-f8f9e11f-191b-4954-9973-bc99a271a695 req-33e0003e-cb56-4233-b84a-089082e9cf33 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Received event network-vif-unplugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Instance destroyed successfully.
Aug 26 16:54:20 user nova-compute[73627]: DEBUG nova.objects.instance [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'resources' on Instance uuid 985dd107-b637-40f6-9c11-abe58ac095bd {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:52:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1803150497',display_name='tempest-TestVolumeBootPattern-server-1803150497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1803150497',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFG7wB0UmOp8pWohUGUbew4A+9iiAIJnhdwGUEPyEdu1HQG05W/Bj3k7KHv07ehiBlxAKsBzl/ZdUB+KCGvVAg+9lfOQY879dDx/zV5sgWDmgodrMTlkSVXktIY1G/3Q==',key_name='tempest-TestVolumeBootPattern-977974239',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:52:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-h6b2lndz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:52:43Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=985dd107-b637-40f6-9c11-abe58ac095bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "address": "fa:16:3e:73:cc:d2", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4552788-55", "ovs_interfaceid": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "address": "fa:16:3e:73:cc:d2", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4552788-55", "ovs_interfaceid": "b4552788-55e3-4102-ae3d-f6bd9b42f527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=b4552788-55e3-4102-ae3d-f6bd9b42f527,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4552788-55') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG os_vif [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=b4552788-55e3-4102-ae3d-f6bd9b42f527,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4552788-55') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4552788-55, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:54:20 user nova-compute[73627]: INFO os_vif [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=b4552788-55e3-4102-ae3d-f6bd9b42f527,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4552788-55')
Aug 26 16:54:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJRemWqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:54:20 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:54:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ee56a9-df5d-4f8d-9b95-d0885012aa5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3840246a-264b-46fe-93ca-86b2edcb7ab5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:54:20 user nova-compute[73627]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 (non-flash)
Aug 26 16:54:20 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:54:20 user nova-compute[73627]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 (non-flash)
Aug 26 16:54:20 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e8398040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfb2cd4-656a-4a37-8fb6-a84e4ca0dd10]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[54030b92-455f-4042-8bee-0185ca2a0d8f]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6d6d9d-88c7-4286-9754-4f8de9eb2ed1]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:54:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e356ca-5af1-40d6-b731-b24c593e5831]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23637393539333931', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b561e9e4', '/dev/disk/by-id/scsi-1SCST_BIOb561e9e4-67959391d981a2e0') {{(pid=84800) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c3c1af-c714-4c25-9169-aa7fe83bf5e8]: (4, None) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87b4271-9f90-4b81-a48e-426f7c9f0f48]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[065d2956-7d35-446f-a123-84b0ee2b1987]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260]
Aug 26 16:54:21 user nova-compute[73627]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260] successful.
Aug 26 16:54:21 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[820bd69d-24d6-44f8-8a31-7e7d66c19f6a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== disconnect_volume: return (306ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:54:21 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Deleting instance files /opt/stack/data/nova/instances/985dd107-b637-40f6-9c11-abe58ac095bd_del
Aug 26 16:54:21 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Deletion of /opt/stack/data/nova/instances/985dd107-b637-40f6-9c11-abe58ac095bd_del complete
Aug 26 16:54:21 user nova-compute[73627]: INFO nova.compute.manager [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 26 16:54:21 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:21 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:54:22 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Took 0.81 seconds to deallocate network for instance.
Aug 26 16:54:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-191efc66-16f8-45fe-847f-4c6a8404e6f6 req-43fc67ba-df1b-4615-9e22-42ad867dece9 service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Received event network-vif-deleted-b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:54:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-7533611e-00bf-4edc-b8e1-bb0bf1a10557 req-2f40419b-b466-4a7c-bd4d-fdbd86ed9fba service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Received event network-vif-plugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:54:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7533611e-00bf-4edc-b8e1-bb0bf1a10557 req-2f40419b-b466-4a7c-bd4d-fdbd86ed9fba service nova] Acquiring lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7533611e-00bf-4edc-b8e1-bb0bf1a10557 req-2f40419b-b466-4a7c-bd4d-fdbd86ed9fba service nova] Lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7533611e-00bf-4edc-b8e1-bb0bf1a10557 req-2f40419b-b466-4a7c-bd4d-fdbd86ed9fba service nova] Lock "985dd107-b637-40f6-9c11-abe58ac095bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-7533611e-00bf-4edc-b8e1-bb0bf1a10557 req-2f40419b-b466-4a7c-bd4d-fdbd86ed9fba service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] No waiting events found dispatching network-vif-plugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:54:22 user nova-compute[73627]: WARNING nova.compute.manager [req-7533611e-00bf-4edc-b8e1-bb0bf1a10557 req-2f40419b-b466-4a7c-bd4d-fdbd86ed9fba service nova] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Received unexpected event network-vif-plugged-b4552788-55e3-4102-ae3d-f6bd9b42f527 for instance with vm_state active and task_state deleting.
Aug 26 16:54:23 user nova-compute[73627]: INFO nova.compute.manager [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Took 1.21 seconds to detach 1 volumes for instance.
Aug 26 16:54:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:23 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:54:23 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:54:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:23 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Deleted allocations for instance 985dd107-b637-40f6-9c11-abe58ac095bd
Aug 26 16:54:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-e87c24b9-ed97-467a-8c12-172cc73dbd5f tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "985dd107-b637-40f6-9c11-abe58ac095bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.617s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:23 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:23 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:26 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG nova.compute.manager [req-b08d4790-7eb1-4946-ac90-875863373b10 req-b4361a1f-0f1c-45fe-8be9-9632bf1e5b18 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received event network-changed-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG nova.compute.manager [req-b08d4790-7eb1-4946-ac90-875863373b10 req-b4361a1f-0f1c-45fe-8be9-9632bf1e5b18 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Refreshing instance network info cache due to event network-changed-47640bf5-754e-4f01-90a7-740813e8498e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b08d4790-7eb1-4946-ac90-875863373b10 req-b4361a1f-0f1c-45fe-8be9-9632bf1e5b18 service nova] Acquiring lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b08d4790-7eb1-4946-ac90-875863373b10 req-b4361a1f-0f1c-45fe-8be9-9632bf1e5b18 service nova] Acquired lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG nova.network.neutron [req-b08d4790-7eb1-4946-ac90-875863373b10 req-b4361a1f-0f1c-45fe-8be9-9632bf1e5b18 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Refreshing network info cache for port 47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:30 user nova-compute[73627]: INFO nova.compute.manager [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Terminating instance
Aug 26 16:54:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-830e3889-6d30-4544-8ea9-a58e5949cf5c req-ed83f6da-176c-4ba9-95de-3c492efc050c service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received event network-vif-unplugged-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-830e3889-6d30-4544-8ea9-a58e5949cf5c req-ed83f6da-176c-4ba9-95de-3c492efc050c service nova] Acquiring lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-830e3889-6d30-4544-8ea9-a58e5949cf5c req-ed83f6da-176c-4ba9-95de-3c492efc050c service nova] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-830e3889-6d30-4544-8ea9-a58e5949cf5c req-ed83f6da-176c-4ba9-95de-3c492efc050c service nova] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-830e3889-6d30-4544-8ea9-a58e5949cf5c req-ed83f6da-176c-4ba9-95de-3c492efc050c service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] No waiting events found dispatching network-vif-unplugged-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.compute.manager [req-830e3889-6d30-4544-8ea9-a58e5949cf5c req-ed83f6da-176c-4ba9-95de-3c492efc050c service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received event network-vif-unplugged-47640bf5-754e-4f01-90a7-740813e8498e for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.network.neutron [req-b08d4790-7eb1-4946-ac90-875863373b10 req-b4361a1f-0f1c-45fe-8be9-9632bf1e5b18 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updated VIF entry in instance network info cache for port 47640bf5-754e-4f01-90a7-740813e8498e. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.network.neutron [req-b08d4790-7eb1-4946-ac90-875863373b10 req-b4361a1f-0f1c-45fe-8be9-9632bf1e5b18 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updating instance_info_cache with network_info: [{"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b08d4790-7eb1-4946-ac90-875863373b10 req-b4361a1f-0f1c-45fe-8be9-9632bf1e5b18 service nova] Releasing lock "refresh_cache-faa17ff2-089a-4499-bde5-3b9314b3c4a7" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:54:31 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Instance destroyed successfully.
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.objects.instance [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lazy-loading 'resources' on Instance uuid faa17ff2-089a-4499-bde5-3b9314b3c4a7 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-699243273',display_name='tempest-TestStampPattern-server-699243273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-699243273',id=41,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClm4sbJTbQecTTto7JpLosQLvUWuSSwBPYQ/9eVAIKa4x5C24J3npTbB1xGl2BdK0pMwRzKGeyIQQpilDlIlaAntYzFvMNplr4IkHrgY6/OLLZmaIAY+eAS/bXWwYiwgg==',key_name='tempest-TestStampPattern-599218896',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:47:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b4b851aec5746a68bb6cd57285b133a',ramdisk_id='',reservation_id='r-ax8t4spe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1807109610',owner_user_name='tempest-TestStampPattern-1807109610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:50:24Z,user_data=None,user_id='23b0873451304eefb3eb0f8f01727182',uuid=faa17ff2-089a-4499-bde5-3b9314b3c4a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converting VIF {"id": "47640bf5-754e-4f01-90a7-740813e8498e", "address": "fa:16:3e:bb:46:cf", "network": {"id": "e0b5fdac-a585-431c-b744-addff0a8733d", "bridge": "br-int", "label": "tempest-TestStampPattern-288613114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4b851aec5746a68bb6cd57285b133a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47640bf5-75", "ovs_interfaceid": "47640bf5-754e-4f01-90a7-740813e8498e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:46:cf,bridge_name='br-int',has_traffic_filtering=True,id=47640bf5-754e-4f01-90a7-740813e8498e,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47640bf5-75') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG os_vif [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:46:cf,bridge_name='br-int',has_traffic_filtering=True,id=47640bf5-754e-4f01-90a7-740813e8498e,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47640bf5-75') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47640bf5-75, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:54:31 user nova-compute[73627]: INFO os_vif [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:46:cf,bridge_name='br-int',has_traffic_filtering=True,id=47640bf5-754e-4f01-90a7-740813e8498e,network=Network(e0b5fdac-a585-431c-b744-addff0a8733d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47640bf5-75')
Aug 26 16:54:31 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Deleting instance files /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7_del
Aug 26 16:54:31 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Deletion of /opt/stack/data/nova/instances/faa17ff2-089a-4499-bde5-3b9314b3c4a7_del complete
Aug 26 16:54:31 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Skipping network cache update for instance because it is being deleted. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 26 16:54:31 user nova-compute[73627]: INFO nova.compute.manager [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 26 16:54:31 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:54:31 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid 228134a5-86c8-47bc-a34d-e0aba6b33e08 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Updating instance_info_cache with network_info: [{"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:32 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Took 0.57 seconds to deallocate network for instance.
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Refreshing inventories for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Updating ProviderTree inventory for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Updating inventory in ProviderTree for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Refreshing aggregate associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, aggregates: None {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Refreshing trait associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:32 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Deleted allocations for instance faa17ff2-089a-4499-bde5-3b9314b3c4a7
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-c392af5c-c73c-4a42-8e0f-af9e1c097ac9 tempest-TestStampPattern-1807109610 tempest-TestStampPattern-1807109610-project-member] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.039s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:32 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.compute.manager [req-d3ba36fe-7604-4994-a8b4-764c96afaad8 req-0dded58d-1d91-42d4-91a1-456a5eadd6d4 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received event network-vif-plugged-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d3ba36fe-7604-4994-a8b4-764c96afaad8 req-0dded58d-1d91-42d4-91a1-456a5eadd6d4 service nova] Acquiring lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d3ba36fe-7604-4994-a8b4-764c96afaad8 req-0dded58d-1d91-42d4-91a1-456a5eadd6d4 service nova] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d3ba36fe-7604-4994-a8b4-764c96afaad8 req-0dded58d-1d91-42d4-91a1-456a5eadd6d4 service nova] Lock "faa17ff2-089a-4499-bde5-3b9314b3c4a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.compute.manager [req-d3ba36fe-7604-4994-a8b4-764c96afaad8 req-0dded58d-1d91-42d4-91a1-456a5eadd6d4 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] No waiting events found dispatching network-vif-plugged-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:54:33 user nova-compute[73627]: WARNING nova.compute.manager [req-d3ba36fe-7604-4994-a8b4-764c96afaad8 req-0dded58d-1d91-42d4-91a1-456a5eadd6d4 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received unexpected event network-vif-plugged-47640bf5-754e-4f01-90a7-740813e8498e for instance with vm_state deleted and task_state None.
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.compute.manager [req-d3ba36fe-7604-4994-a8b4-764c96afaad8 req-0dded58d-1d91-42d4-91a1-456a5eadd6d4 service nova] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Received event network-vif-deleted-47640bf5-754e-4f01-90a7-740813e8498e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:54:33 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:54:33 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8533MB free_disk=25.229270935058594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 228134a5-86c8-47bc-a34d-e0aba6b33e08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 520302ac-ba6b-4954-9acf-827b9e070fd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:54:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:54:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:35 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068860.7203193, 985dd107-b637-40f6-9c11-abe58ac095bd => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:54:35 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] VM Stopped (Lifecycle Event)
Aug 26 16:54:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9df5637a-6432-4aae-80df-aad8bdff4405 None None] [instance: 985dd107-b637-40f6-9c11-abe58ac095bd] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:54:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:54:43 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73627) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "520302ac-ba6b-4954-9acf-827b9e070fd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:46 user nova-compute[73627]: INFO nova.compute.manager [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Detaching volume 14a7cb03-b3f4-437b-9b00-7b0ce3e57e98
Aug 26 16:54:46 user nova-compute[73627]: INFO nova.virt.block_device [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Attempting to driver detach volume 14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 from mountpoint /dev/vdb
Aug 26 16:54:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Attempting to detach device vdb from instance 520302ac-ba6b-4954-9acf-827b9e070fd7 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:54:46 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:54:46 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:54:46 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:54:46 user nova-compute[73627]:   <serial>14a7cb03-b3f4-437b-9b00-7b0ce3e57e98</serial>
Aug 26 16:54:46 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:54:46 user nova-compute[73627]: </disk>
Aug 26 16:54:46 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:54:46 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Successfully detached device vdb from instance 520302ac-ba6b-4954-9acf-827b9e070fd7 from the persistent domain config.
Aug 26 16:54:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 520302ac-ba6b-4954-9acf-827b9e070fd7 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:54:46 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:54:46 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:54:46 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:54:46 user nova-compute[73627]:   <serial>14a7cb03-b3f4-437b-9b00-7b0ce3e57e98</serial>
Aug 26 16:54:46 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:54:46 user nova-compute[73627]: </disk>
Aug 26 16:54:46 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "520302ac-ba6b-4954-9acf-827b9e070fd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068871.6224523, faa17ff2-089a-4499-bde5-3b9314b3c4a7 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:54:46 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] VM Stopped (Lifecycle Event)
Aug 26 16:54:46 user nova-compute[73627]: DEBUG nova.compute.manager [None req-b546c1e5-b19b-4e9a-a160-eec0a54021a7 None None] [instance: faa17ff2-089a-4499-bde5-3b9314b3c4a7] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] There are 0 instances to clean {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693068886.9317038, 520302ac-ba6b-4954-9acf-827b9e070fd7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 520302ac-ba6b-4954-9acf-827b9e070fd7 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:54:46 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Successfully detached device vdb from instance 520302ac-ba6b-4954-9acf-827b9e070fd7 from the live domain config.
Aug 26 16:54:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiVOPFJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:54:46 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:54:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e06d55f-82f5-4ad5-84d2-cccb0f4ba06a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[619f7959-e3c5-41e4-9b62-9cf5713659af]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 (non-flash)
Aug 26 16:54:46 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 (non-flash)
Aug 26 16:54:46 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3e8359870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:54:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6d7ca2-4591-40fd-8272-adf113e1a444]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a426b0b4-db30-4f53-8166-438c5bd5eeaa]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[69033c38-1a70-4beb-95c4-02c19fbe24b9]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[776918cd-549f-48f0-aeaa-573f162d7a00]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4072d564-05e0-4259-a380-3aef88908b60]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1dc409-8bdb-4056-94ff-7050bdef2eac]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98, portal: 172.16.0.220,3260]
Aug 26 16:54:47 user nova-compute[73627]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98, portal: 172.16.0.220,3260] successful.
Aug 26 16:54:47 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3af8806-2160-4e7c-aade-b206cc3771c3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] <== disconnect_volume: return (260ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:54:47 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.objects.instance [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lazy-loading 'flavor' on Instance uuid 520302ac-ba6b-4954-9acf-827b9e070fd7 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-b808e61c-2c3c-4133-a1a8-72875fb3241f tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.683s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.552s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:48 user nova-compute[73627]: INFO nova.compute.manager [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Terminating instance
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-5eacaa2c-1bb0-45a2-8dfd-50017d8fec8b req-6224a894-6840-426d-9336-30a346952356 service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Received event network-vif-unplugged-74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5eacaa2c-1bb0-45a2-8dfd-50017d8fec8b req-6224a894-6840-426d-9336-30a346952356 service nova] Acquiring lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5eacaa2c-1bb0-45a2-8dfd-50017d8fec8b req-6224a894-6840-426d-9336-30a346952356 service nova] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-5eacaa2c-1bb0-45a2-8dfd-50017d8fec8b req-6224a894-6840-426d-9336-30a346952356 service nova] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-5eacaa2c-1bb0-45a2-8dfd-50017d8fec8b req-6224a894-6840-426d-9336-30a346952356 service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] No waiting events found dispatching network-vif-unplugged-74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-5eacaa2c-1bb0-45a2-8dfd-50017d8fec8b req-6224a894-6840-426d-9336-30a346952356 service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Received event network-vif-unplugged-74ac69f7-7544-491d-84f2-d14b929ef9ac for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:48 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Instance destroyed successfully.
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.objects.instance [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lazy-loading 'resources' on Instance uuid 520302ac-ba6b-4954-9acf-827b9e070fd7 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:51:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-186642349',display_name='tempest-VolumesSnapshotTestJSON-instance-186642349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-186642349',id=47,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrqpa/x2RjlO+jkV/hZdbbURrAlKNkK8HzoolMLTkiExj0MwIgQZtJoYPbWxN4B95+Jt6dxidwGcWZ5IcYLElB+pPbTq6x4QaycyfIAcVO7OEIhFyh5MUe9lyRw704KtQ==',key_name='tempest-keypair-66874122',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:52:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1550b44802843dca4d2f8ad38adbc12',ramdisk_id='',reservation_id='r-wuil2lr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-351265767',owner_user_name='tempest-VolumesSnapshotTestJSON-351265767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:52:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3725a470efe84258825ac4db497f6761',uuid=520302ac-ba6b-4954-9acf-827b9e070fd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "address": "fa:16:3e:6f:38:22", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ac69f7-75", "ovs_interfaceid": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converting VIF {"id": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "address": "fa:16:3e:6f:38:22", "network": {"id": "5ae3320e-7680-4261-939f-c2b2520a0434", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924849659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1550b44802843dca4d2f8ad38adbc12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ac69f7-75", "ovs_interfaceid": "74ac69f7-7544-491d-84f2-d14b929ef9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:38:22,bridge_name='br-int',has_traffic_filtering=True,id=74ac69f7-7544-491d-84f2-d14b929ef9ac,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ac69f7-75') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG os_vif [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:38:22,bridge_name='br-int',has_traffic_filtering=True,id=74ac69f7-7544-491d-84f2-d14b929ef9ac,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ac69f7-75') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74ac69f7-75, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:54:48 user nova-compute[73627]: INFO os_vif [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:38:22,bridge_name='br-int',has_traffic_filtering=True,id=74ac69f7-7544-491d-84f2-d14b929ef9ac,network=Network(5ae3320e-7680-4261-939f-c2b2520a0434),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ac69f7-75')
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiVOPFJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:54:48 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:54:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14a7cb03-b3f4-437b-9b00-7b0ce3e57e98', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[12183466-a9aa-422a-84d8-c66aa9719b9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:48 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 26 16:54:48 user nova-compute[73627]: 
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc09bf1a-fe0c-4deb-b787-070b2d7dacbc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:54:48 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:54:48 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:54:48 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 16:54:48 user nova-compute[73627]: 
Aug 26 16:54:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d0240d30>, {}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Disconnecting from: [] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.044s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] <== disconnect_volume: return (45ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:54:48 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Deleting instance files /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7_del
Aug 26 16:54:48 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Deletion of /opt/stack/data/nova/instances/520302ac-ba6b-4954-9acf-827b9e070fd7_del complete
Aug 26 16:54:48 user nova-compute[73627]: INFO nova.compute.manager [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 16:54:48 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:54:48 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:54:49 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:54:49 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Took 0.95 seconds to deallocate network for instance.
Aug 26 16:54:49 user nova-compute[73627]: WARNING nova.volume.cinder [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Attachment d6fb9dad-31ae-4e8e-b1e3-6d6d7b1d4d7c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d6fb9dad-31ae-4e8e-b1e3-6d6d7b1d4d7c. (HTTP 404) (Request-ID: req-b18a9686-093d-420f-95bc-188e15ad072d)
Aug 26 16:54:49 user nova-compute[73627]: INFO nova.compute.manager [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Took 0.02 seconds to detach 1 volumes for instance.
Aug 26 16:54:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:50 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:54:50 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:54:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:50 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Deleted allocations for instance 520302ac-ba6b-4954-9acf-827b9e070fd7
Aug 26 16:54:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5ce5a87a-5cc2-4cb7-bfb4-d8998bddbd72 tempest-VolumesSnapshotTestJSON-351265767 tempest-VolumesSnapshotTestJSON-351265767-project-member] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.173s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-9a95a64d-b175-4e35-b60f-cc2d3557cc76 req-338c2e5c-5ece-4841-ad4a-5a37b60f2c4d service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Received event network-vif-plugged-74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:54:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9a95a64d-b175-4e35-b60f-cc2d3557cc76 req-338c2e5c-5ece-4841-ad4a-5a37b60f2c4d service nova] Acquiring lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:54:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9a95a64d-b175-4e35-b60f-cc2d3557cc76 req-338c2e5c-5ece-4841-ad4a-5a37b60f2c4d service nova] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:54:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-9a95a64d-b175-4e35-b60f-cc2d3557cc76 req-338c2e5c-5ece-4841-ad4a-5a37b60f2c4d service nova] Lock "520302ac-ba6b-4954-9acf-827b9e070fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:54:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-9a95a64d-b175-4e35-b60f-cc2d3557cc76 req-338c2e5c-5ece-4841-ad4a-5a37b60f2c4d service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] No waiting events found dispatching network-vif-plugged-74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:54:50 user nova-compute[73627]: WARNING nova.compute.manager [req-9a95a64d-b175-4e35-b60f-cc2d3557cc76 req-338c2e5c-5ece-4841-ad4a-5a37b60f2c4d service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Received unexpected event network-vif-plugged-74ac69f7-7544-491d-84f2-d14b929ef9ac for instance with vm_state deleted and task_state None.
Aug 26 16:54:50 user nova-compute[73627]: DEBUG nova.compute.manager [req-9a95a64d-b175-4e35-b60f-cc2d3557cc76 req-338c2e5c-5ece-4841-ad4a-5a37b60f2c4d service nova] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Received event network-vif-deleted-74ac69f7-7544-491d-84f2-d14b929ef9ac {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:54:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:54:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:55:03 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693068888.8308609, 520302ac-ba6b-4954-9acf-827b9e070fd7 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:55:03 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] VM Stopped (Lifecycle Event)
Aug 26 16:55:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-3cbbd7ab-010b-4dcd-a747-f514f9f42b3c None None] [instance: 520302ac-ba6b-4954-9acf-827b9e070fd7] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:55:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:55:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:55:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:55:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:55:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "466ba946-4678-4c5a-ae53-bfa43b051c41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:55:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:11 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:55:11 user nova-compute[73627]: INFO nova.compute.claims [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Claim successful on node user
Aug 26 16:55:11 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:55:11 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:55:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:55:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:55:11 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:55:11 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:55:12 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:55:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:55:12 user nova-compute[73627]: INFO nova.virt.block_device [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Booting with volume 15f33b3b-6cfd-419d-9497-723c95217ad0 at /dev/vda
Aug 26 16:55:12 user nova-compute[73627]: DEBUG nova.policy [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c2828f3769d420b9d9caef2e6bc902f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4241157d52c848d49bed0589c2ec725e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG os_brick.utils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f068aa47-4f1c-4b87-9a0a-6abe8f185a04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3522d070-f813-4fdd-80a3-db8f5420eaf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[165ccd48-7417-482c-ac54-921b643854a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d89f98-11e2-49b6-b5b3-f515f83dce67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:55:12 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:55:12 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[23deee9c-6a08-4c7f-9cb5-8bb2bbf77c96]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG os_brick.utils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updating existing volume attachment record: 6e5c6098-fd63-4f21-99e4-be9fd6893cf9 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:55:12 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Successfully created port: 86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:55:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:55:13 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Successfully updated port: 86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:55:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:55:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquired lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:55:13 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-baefec89-6ee6-4682-82bd-3c337872a7e9 req-9f41b0ca-4f4a-4620-9b0b-fbb648e4dcb8 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received event network-changed-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-baefec89-6ee6-4682-82bd-3c337872a7e9 req-9f41b0ca-4f4a-4620-9b0b-fbb648e4dcb8 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Refreshing instance network info cache due to event network-changed-86903036-0d66-48f3-8dc0-005508f65f9e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-baefec89-6ee6-4682-82bd-3c337872a7e9 req-9f41b0ca-4f4a-4620-9b0b-fbb648e4dcb8 service nova] Acquiring lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG nova.network.neutron [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updating instance_info_cache with network_info: [{"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Releasing lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Instance network_info: |[{"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-baefec89-6ee6-4682-82bd-3c337872a7e9 req-9f41b0ca-4f4a-4620-9b0b-fbb648e4dcb8 service nova] Acquired lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG nova.network.neutron [req-baefec89-6ee6-4682-82bd-3c337872a7e9 req-9f41b0ca-4f4a-4620-9b0b-fbb648e4dcb8 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Refreshing network info cache for port 86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG nova.network.neutron [req-baefec89-6ee6-4682-82bd-3c337872a7e9 req-9f41b0ca-4f4a-4620-9b0b-fbb648e4dcb8 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updated VIF entry in instance network info cache for port 86903036-0d66-48f3-8dc0-005508f65f9e. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG nova.network.neutron [req-baefec89-6ee6-4682-82bd-3c337872a7e9 req-9f41b0ca-4f4a-4620-9b0b-fbb648e4dcb8 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updating instance_info_cache with network_info: [{"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:55:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-baefec89-6ee6-4682-82bd-3c337872a7e9 req-9f41b0ca-4f4a-4620-9b0b-fbb648e4dcb8 service nova] Releasing lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:55:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:55:23 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Creating image(s)
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Ensure instance console log exists: /opt/stack/data/nova/instances/466ba946-4678-4c5a-ae53-bfa43b051c41/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Start _get_guest_xml network_info=[{"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJRemWqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '466ba946-4678-4c5a-ae53-bfa43b051c41', 'attached_at': '', 'detached_at': '', 'volume_id': '15f33b3b-6cfd-419d-9497-723c95217ad0', 'serial': '15f33b3b-6cfd-419d-9497-723c95217ad0'}, 'guest_format': None, 'attachment_id': '6e5c6098-fd63-4f21-99e4-be9fd6893cf9', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:55:23 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:55:23 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJRemWqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:55:23 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:55:23 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:55:23 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cda0e3-bac9-4154-be88-bad9edf0f85a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:55:23 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34b86d4-1871-411c-b3ad-513ec663aa71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0] added
Aug 26 16:55:23 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38409b8-1043-43ba-8be7-724b2fcdebdb]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[740a992d-c0ad-4475-a85c-ff47e87028dc]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJRemWqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJRemWqn" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e098f9-b5b8-4915-9ec7-98fe9b315e12]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VJRemWqn'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5451296-d8da-400b-9295-4fb295542784]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f94e0e-96da-4b5e-9645-a874d899d62d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:55:23 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 16:55:23 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:55:23 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 16:55:23 user nova-compute[73627]: 
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c13f51-cf05-4992-9346-c31f766c0ba7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260]
Aug 26 16:55:23 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260] successful.
Aug 26 16:55:23 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc0d89f-79e3-4f37-8f17-f5d4da30a102]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07b4b16-ebac-4b91-82c8-051aed2abee8]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:55:23 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:55:23 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7f2e6e-44de-407b-a94d-7476d2748374]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:55:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJRemWqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23637393539333931', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637393539333931', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-456233068',display_name='tempest-TestVolumeBootPattern-server-456233068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-456233068',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFG7wB0UmOp8pWohUGUbew4A+9iiAIJnhdwGUEPyEdu1HQG05W/Bj3k7KHv07ehiBlxAKsBzl/ZdUB+KCGvVAg+9lfOQY879dDx/zV5sgWDmgodrMTlkSVXktIY1G/3Q==',key_name='tempest-TestVolumeBootPattern-977974239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-en5elix5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:55:12Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=466ba946-4678-4c5a-ae53-bfa43b051c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:11:96,bridge_name='br-int',has_traffic_filtering=True,id=86903036-0d66-48f3-8dc0-005508f65f9e,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86903036-0d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG nova.objects.instance [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'pci_devices' on Instance uuid 466ba946-4678-4c5a-ae53-bfa43b051c41 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:55:24 user nova-compute[73627]:   <uuid>466ba946-4678-4c5a-ae53-bfa43b051c41</uuid>
Aug 26 16:55:24 user nova-compute[73627]:   <name>instance-00000031</name>
Aug 26 16:55:24 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:55:24 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:55:24 user nova-compute[73627]:   <metadata>
Aug 26 16:55:24 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:55:24 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:55:24 user nova-compute[73627]:       <nova:name>tempest-TestVolumeBootPattern-server-456233068</nova:name>
Aug 26 16:55:24 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:55:23</nova:creationTime>
Aug 26 16:55:24 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:55:24 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:55:24 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:55:24 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:55:24 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:55:24 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:55:24 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:55:24 user nova-compute[73627]:       <nova:owner>
Aug 26 16:55:24 user nova-compute[73627]:         <nova:user uuid="1c2828f3769d420b9d9caef2e6bc902f">tempest-TestVolumeBootPattern-1705344746-project-member</nova:user>
Aug 26 16:55:24 user nova-compute[73627]:         <nova:project uuid="4241157d52c848d49bed0589c2ec725e">tempest-TestVolumeBootPattern-1705344746</nova:project>
Aug 26 16:55:24 user nova-compute[73627]:       </nova:owner>
Aug 26 16:55:24 user nova-compute[73627]:       <nova:ports>
Aug 26 16:55:24 user nova-compute[73627]:         <nova:port uuid="86903036-0d66-48f3-8dc0-005508f65f9e">
Aug 26 16:55:24 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 16:55:24 user nova-compute[73627]:         </nova:port>
Aug 26 16:55:24 user nova-compute[73627]:       </nova:ports>
Aug 26 16:55:24 user nova-compute[73627]:     </nova:instance>
Aug 26 16:55:24 user nova-compute[73627]:   </metadata>
Aug 26 16:55:24 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:55:24 user nova-compute[73627]:     <system>
Aug 26 16:55:24 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:55:24 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:55:24 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:55:24 user nova-compute[73627]:       <entry name="serial">466ba946-4678-4c5a-ae53-bfa43b051c41</entry>
Aug 26 16:55:24 user nova-compute[73627]:       <entry name="uuid">466ba946-4678-4c5a-ae53-bfa43b051c41</entry>
Aug 26 16:55:24 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:55:24 user nova-compute[73627]:     </system>
Aug 26 16:55:24 user nova-compute[73627]:   </sysinfo>
Aug 26 16:55:24 user nova-compute[73627]:   <os>
Aug 26 16:55:24 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:55:24 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:55:24 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:55:24 user nova-compute[73627]:   </os>
Aug 26 16:55:24 user nova-compute[73627]:   <features>
Aug 26 16:55:24 user nova-compute[73627]:     <acpi/>
Aug 26 16:55:24 user nova-compute[73627]:     <apic/>
Aug 26 16:55:24 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:55:24 user nova-compute[73627]:   </features>
Aug 26 16:55:24 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:55:24 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:55:24 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:55:24 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:55:24 user nova-compute[73627]:   </clock>
Aug 26 16:55:24 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:55:24 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:55:24 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:55:24 user nova-compute[73627]:   </cpu>
Aug 26 16:55:24 user nova-compute[73627]:   <devices>
Aug 26 16:55:24 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:55:24 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:55:24 user nova-compute[73627]:       <source dev="/dev/sdb"/>
Aug 26 16:55:24 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:55:24 user nova-compute[73627]:       <serial>15f33b3b-6cfd-419d-9497-723c95217ad0</serial>
Aug 26 16:55:24 user nova-compute[73627]:     </disk>
Aug 26 16:55:24 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:55:24 user nova-compute[73627]:       <mac address="fa:16:3e:f9:11:96"/>
Aug 26 16:55:24 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:55:24 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:55:24 user nova-compute[73627]:       <target dev="tap86903036-0d"/>
Aug 26 16:55:24 user nova-compute[73627]:     </interface>
Aug 26 16:55:24 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:55:24 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/466ba946-4678-4c5a-ae53-bfa43b051c41/console.log" append="off"/>
Aug 26 16:55:24 user nova-compute[73627]:     </serial>
Aug 26 16:55:24 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:55:24 user nova-compute[73627]:     <video>
Aug 26 16:55:24 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:55:24 user nova-compute[73627]:     </video>
Aug 26 16:55:24 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:55:24 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:55:24 user nova-compute[73627]:     </rng>
Aug 26 16:55:24 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:55:24 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:55:24 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:55:24 user nova-compute[73627]:     </memballoon>
Aug 26 16:55:24 user nova-compute[73627]:   </devices>
Aug 26 16:55:24 user nova-compute[73627]: </domain>
Aug 26 16:55:24 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-456233068',display_name='tempest-TestVolumeBootPattern-server-456233068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-456233068',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFG7wB0UmOp8pWohUGUbew4A+9iiAIJnhdwGUEPyEdu1HQG05W/Bj3k7KHv07ehiBlxAKsBzl/ZdUB+KCGvVAg+9lfOQY879dDx/zV5sgWDmgodrMTlkSVXktIY1G/3Q==',key_name='tempest-TestVolumeBootPattern-977974239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-en5elix5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:55:12Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=466ba946-4678-4c5a-ae53-bfa43b051c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:11:96,bridge_name='br-int',has_traffic_filtering=True,id=86903036-0d66-48f3-8dc0-005508f65f9e,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86903036-0d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG os_vif [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:11:96,bridge_name='br-int',has_traffic_filtering=True,id=86903036-0d66-48f3-8dc0-005508f65f9e,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86903036-0d') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86903036-0d, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86903036-0d, col_values=(('external_ids', {'iface-id': '86903036-0d66-48f3-8dc0-005508f65f9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:11:96', 'vm-uuid': '466ba946-4678-4c5a-ae53-bfa43b051c41'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:24 user nova-compute[73627]: INFO os_vif [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:11:96,bridge_name='br-int',has_traffic_filtering=True,id=86903036-0d66-48f3-8dc0-005508f65f9e,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86903036-0d')
Aug 26 16:55:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No VIF found with MAC fa:16:3e:f9:11:96, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:55:24 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:55:25 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:55:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-f97731c8-d0bd-4e4d-98a1-6ec4d3c45826 req-2dec746a-4cae-4867-a44e-79d0a5b1f9fc service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received event network-vif-plugged-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:55:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f97731c8-d0bd-4e4d-98a1-6ec4d3c45826 req-2dec746a-4cae-4867-a44e-79d0a5b1f9fc service nova] Acquiring lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f97731c8-d0bd-4e4d-98a1-6ec4d3c45826 req-2dec746a-4cae-4867-a44e-79d0a5b1f9fc service nova] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:26 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-f97731c8-d0bd-4e4d-98a1-6ec4d3c45826 req-2dec746a-4cae-4867-a44e-79d0a5b1f9fc service nova] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:55:26 user nova-compute[73627]: DEBUG nova.compute.manager [req-f97731c8-d0bd-4e4d-98a1-6ec4d3c45826 req-2dec746a-4cae-4867-a44e-79d0a5b1f9fc service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] No waiting events found dispatching network-vif-plugged-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:55:26 user nova-compute[73627]: WARNING nova.compute.manager [req-f97731c8-d0bd-4e4d-98a1-6ec4d3c45826 req-2dec746a-4cae-4867-a44e-79d0a5b1f9fc service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received unexpected event network-vif-plugged-86903036-0d66-48f3-8dc0-005508f65f9e for instance with vm_state building and task_state spawning.
Aug 26 16:55:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068927.8771832, 466ba946-4678-4c5a-ae53-bfa43b051c41 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:55:27 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] VM Resumed (Lifecycle Event)
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:55:27 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Instance spawned successfully.
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:55:27 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068927.878765, 466ba946-4678-4c5a-ae53-bfa43b051c41 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:55:27 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] VM Started (Lifecycle Event)
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:55:27 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:55:27 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:55:28 user nova-compute[73627]: INFO nova.compute.manager [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 26 16:55:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:55:28 user nova-compute[73627]: INFO nova.compute.manager [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Took 16.45 seconds to build instance.
Aug 26 16:55:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-d5e2056a-bb6f-4192-a811-8515b497b300 req-ced56e47-0005-4525-9420-99b35dae64ca service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received event network-vif-plugged-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:55:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d5e2056a-bb6f-4192-a811-8515b497b300 req-ced56e47-0005-4525-9420-99b35dae64ca service nova] Acquiring lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d5e2056a-bb6f-4192-a811-8515b497b300 req-ced56e47-0005-4525-9420-99b35dae64ca service nova] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d5e2056a-bb6f-4192-a811-8515b497b300 req-ced56e47-0005-4525-9420-99b35dae64ca service nova] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:55:28 user nova-compute[73627]: DEBUG nova.compute.manager [req-d5e2056a-bb6f-4192-a811-8515b497b300 req-ced56e47-0005-4525-9420-99b35dae64ca service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] No waiting events found dispatching network-vif-plugged-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:55:28 user nova-compute[73627]: WARNING nova.compute.manager [req-d5e2056a-bb6f-4192-a811-8515b497b300 req-ced56e47-0005-4525-9420-99b35dae64ca service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received unexpected event network-vif-plugged-86903036-0d66-48f3-8dc0-005508f65f9e for instance with vm_state building and task_state spawning.
Aug 26 16:55:28 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5981ca16-d521-433c-a03f-39b58f3e8921 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.554s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:55:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:29 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:55:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:55:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:55:33 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 16:55:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:55:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:55:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:55:33 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:55:33 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:55:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:34 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:55:34 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:55:34 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8589MB free_disk=25.254520416259766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 228134a5-86c8-47bc-a34d-e0aba6b33e08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 466ba946-4678-4c5a-ae53-bfa43b051c41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:55:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:55:35 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:55:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:55:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:36 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:55:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:42 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:45 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:55:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:49 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG nova.compute.manager [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:55:57 user nova-compute[73627]: INFO nova.compute.claims [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Claim successful on node user
Aug 26 16:55:57 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG nova.compute.manager [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG nova.compute.manager [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG nova.network.neutron [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:55:57 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:55:57 user nova-compute[73627]: DEBUG nova.compute.manager [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG nova.policy [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c756d899bea14660af19edf3c6211e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e47398f849465a94ca0b16646b7c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG nova.compute.manager [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:55:57 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Creating image(s)
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "/opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "/opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "/opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.171s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:57 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk 1073741824" returned: 0 in 0.066s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.207s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG nova.network.neutron [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Successfully created port: a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Cannot resize image /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Ensure instance console log exists: /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:55:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.network.neutron [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Successfully updated port: a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquired lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.network.neutron [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-46717bbb-416a-4f97-bcfb-8fe0f6b7d609 req-75c4c98f-ab9e-4a72-abfc-0fcfed9a08a9 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Received event network-changed-a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.compute.manager [req-46717bbb-416a-4f97-bcfb-8fe0f6b7d609 req-75c4c98f-ab9e-4a72-abfc-0fcfed9a08a9 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Refreshing instance network info cache due to event network-changed-a28456a3-e363-4a62-9d69-b4219a1d275b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-46717bbb-416a-4f97-bcfb-8fe0f6b7d609 req-75c4c98f-ab9e-4a72-abfc-0fcfed9a08a9 service nova] Acquiring lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.network.neutron [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.network.neutron [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating instance_info_cache with network_info: [{"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Releasing lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.compute.manager [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Instance network_info: |[{"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-46717bbb-416a-4f97-bcfb-8fe0f6b7d609 req-75c4c98f-ab9e-4a72-abfc-0fcfed9a08a9 service nova] Acquired lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.network.neutron [req-46717bbb-416a-4f97-bcfb-8fe0f6b7d609 req-75c4c98f-ab9e-4a72-abfc-0fcfed9a08a9 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Refreshing network info cache for port a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Start _get_guest_xml network_info=[{"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:55:59 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:55:59 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1845761964',display_name='tempest-SnapshotDataIntegrityTests-server-1845761964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1845761964',id=50,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaJ04hwK6dQQRk56PsrPCTXf6nlCoX6oMUwprrzmQwDHkEgQLkxEUymnsNujpH1uXg7VpTp6B7B+NUYhgLM0JAeRh12eaTZt00Cp6Rp1ORpp8wdcaAV91Ti+ZYUMrVjjw==',key_name='tempest-keypair-2037966096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63e47398f849465a94ca0b16646b7c79',ramdisk_id='',reservation_id='r-elihh9td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-439186932',owner_user_name='tempest-SnapshotDataIntegrityTests-439186932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c756d899bea14660af19edf3c6211e92',uuid=de0d18ed-530c-4c9d-9940-c147b6ac2562,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Converting VIF {"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6b:b0,bridge_name='br-int',has_traffic_filtering=True,id=a28456a3-e363-4a62-9d69-b4219a1d275b,network=Network(2883bbbb-728b-43fe-a8a9-3435c029e8a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28456a3-e3') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.objects.instance [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'pci_devices' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:55:59 user nova-compute[73627]:   <uuid>de0d18ed-530c-4c9d-9940-c147b6ac2562</uuid>
Aug 26 16:55:59 user nova-compute[73627]:   <name>instance-00000032</name>
Aug 26 16:55:59 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:55:59 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:55:59 user nova-compute[73627]:   <metadata>
Aug 26 16:55:59 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:55:59 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:55:59 user nova-compute[73627]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1845761964</nova:name>
Aug 26 16:55:59 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:55:59</nova:creationTime>
Aug 26 16:55:59 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:55:59 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:55:59 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:55:59 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:55:59 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:55:59 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:55:59 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:55:59 user nova-compute[73627]:       <nova:owner>
Aug 26 16:55:59 user nova-compute[73627]:         <nova:user uuid="c756d899bea14660af19edf3c6211e92">tempest-SnapshotDataIntegrityTests-439186932-project-member</nova:user>
Aug 26 16:55:59 user nova-compute[73627]:         <nova:project uuid="63e47398f849465a94ca0b16646b7c79">tempest-SnapshotDataIntegrityTests-439186932</nova:project>
Aug 26 16:55:59 user nova-compute[73627]:       </nova:owner>
Aug 26 16:55:59 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 16:55:59 user nova-compute[73627]:       <nova:ports>
Aug 26 16:55:59 user nova-compute[73627]:         <nova:port uuid="a28456a3-e363-4a62-9d69-b4219a1d275b">
Aug 26 16:55:59 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 16:55:59 user nova-compute[73627]:         </nova:port>
Aug 26 16:55:59 user nova-compute[73627]:       </nova:ports>
Aug 26 16:55:59 user nova-compute[73627]:     </nova:instance>
Aug 26 16:55:59 user nova-compute[73627]:   </metadata>
Aug 26 16:55:59 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:55:59 user nova-compute[73627]:     <system>
Aug 26 16:55:59 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:55:59 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:55:59 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:55:59 user nova-compute[73627]:       <entry name="serial">de0d18ed-530c-4c9d-9940-c147b6ac2562</entry>
Aug 26 16:55:59 user nova-compute[73627]:       <entry name="uuid">de0d18ed-530c-4c9d-9940-c147b6ac2562</entry>
Aug 26 16:55:59 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:55:59 user nova-compute[73627]:     </system>
Aug 26 16:55:59 user nova-compute[73627]:   </sysinfo>
Aug 26 16:55:59 user nova-compute[73627]:   <os>
Aug 26 16:55:59 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:55:59 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:55:59 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:55:59 user nova-compute[73627]:   </os>
Aug 26 16:55:59 user nova-compute[73627]:   <features>
Aug 26 16:55:59 user nova-compute[73627]:     <acpi/>
Aug 26 16:55:59 user nova-compute[73627]:     <apic/>
Aug 26 16:55:59 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:55:59 user nova-compute[73627]:   </features>
Aug 26 16:55:59 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:55:59 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:55:59 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:55:59 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:55:59 user nova-compute[73627]:   </clock>
Aug 26 16:55:59 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:55:59 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:55:59 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:55:59 user nova-compute[73627]:   </cpu>
Aug 26 16:55:59 user nova-compute[73627]:   <devices>
Aug 26 16:55:59 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 16:55:59 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 16:55:59 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk"/>
Aug 26 16:55:59 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:55:59 user nova-compute[73627]:     </disk>
Aug 26 16:55:59 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:55:59 user nova-compute[73627]:       <mac address="fa:16:3e:e7:6b:b0"/>
Aug 26 16:55:59 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:55:59 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:55:59 user nova-compute[73627]:       <target dev="tapa28456a3-e3"/>
Aug 26 16:55:59 user nova-compute[73627]:     </interface>
Aug 26 16:55:59 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:55:59 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/console.log" append="off"/>
Aug 26 16:55:59 user nova-compute[73627]:     </serial>
Aug 26 16:55:59 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:55:59 user nova-compute[73627]:     <video>
Aug 26 16:55:59 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:55:59 user nova-compute[73627]:     </video>
Aug 26 16:55:59 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:55:59 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:55:59 user nova-compute[73627]:     </rng>
Aug 26 16:55:59 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:55:59 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:55:59 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:55:59 user nova-compute[73627]:     </memballoon>
Aug 26 16:55:59 user nova-compute[73627]:   </devices>
Aug 26 16:55:59 user nova-compute[73627]: </domain>
Aug 26 16:55:59 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1845761964',display_name='tempest-SnapshotDataIntegrityTests-server-1845761964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1845761964',id=50,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaJ04hwK6dQQRk56PsrPCTXf6nlCoX6oMUwprrzmQwDHkEgQLkxEUymnsNujpH1uXg7VpTp6B7B+NUYhgLM0JAeRh12eaTZt00Cp6Rp1ORpp8wdcaAV91Ti+ZYUMrVjjw==',key_name='tempest-keypair-2037966096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63e47398f849465a94ca0b16646b7c79',ramdisk_id='',reservation_id='r-elihh9td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-439186932',owner_user_name='tempest-SnapshotDataIntegrityTests-439186932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c756d899bea14660af19edf3c6211e92',uuid=de0d18ed-530c-4c9d-9940-c147b6ac2562,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Converting VIF {"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6b:b0,bridge_name='br-int',has_traffic_filtering=True,id=a28456a3-e363-4a62-9d69-b4219a1d275b,network=Network(2883bbbb-728b-43fe-a8a9-3435c029e8a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28456a3-e3') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG os_vif [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6b:b0,bridge_name='br-int',has_traffic_filtering=True,id=a28456a3-e363-4a62-9d69-b4219a1d275b,network=Network(2883bbbb-728b-43fe-a8a9-3435c029e8a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28456a3-e3') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa28456a3-e3, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa28456a3-e3, col_values=(('external_ids', {'iface-id': 'a28456a3-e363-4a62-9d69-b4219a1d275b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:6b:b0', 'vm-uuid': 'de0d18ed-530c-4c9d-9940-c147b6ac2562'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:55:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:55:59 user nova-compute[73627]: INFO os_vif [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6b:b0,bridge_name='br-int',has_traffic_filtering=True,id=a28456a3-e363-4a62-9d69-b4219a1d275b,network=Network(2883bbbb-728b-43fe-a8a9-3435c029e8a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28456a3-e3')
Aug 26 16:56:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:56:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No VIF found with MAC fa:16:3e:e7:6b:b0, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:56:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-46717bbb-416a-4f97-bcfb-8fe0f6b7d609 req-75c4c98f-ab9e-4a72-abfc-0fcfed9a08a9 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updated VIF entry in instance network info cache for port a28456a3-e363-4a62-9d69-b4219a1d275b. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:56:00 user nova-compute[73627]: DEBUG nova.network.neutron [req-46717bbb-416a-4f97-bcfb-8fe0f6b7d609 req-75c4c98f-ab9e-4a72-abfc-0fcfed9a08a9 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating instance_info_cache with network_info: [{"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:56:00 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-46717bbb-416a-4f97-bcfb-8fe0f6b7d609 req-75c4c98f-ab9e-4a72-abfc-0fcfed9a08a9 service nova] Releasing lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:56:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-8ff3a45e-7755-41e5-8a6c-c6804345baa1 req-55943616-6ed7-4d16-8afe-68ba6fa29f06 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Received event network-vif-plugged-a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:56:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8ff3a45e-7755-41e5-8a6c-c6804345baa1 req-55943616-6ed7-4d16-8afe-68ba6fa29f06 service nova] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:56:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8ff3a45e-7755-41e5-8a6c-c6804345baa1 req-55943616-6ed7-4d16-8afe-68ba6fa29f06 service nova] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:56:01 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8ff3a45e-7755-41e5-8a6c-c6804345baa1 req-55943616-6ed7-4d16-8afe-68ba6fa29f06 service nova] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:56:01 user nova-compute[73627]: DEBUG nova.compute.manager [req-8ff3a45e-7755-41e5-8a6c-c6804345baa1 req-55943616-6ed7-4d16-8afe-68ba6fa29f06 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] No waiting events found dispatching network-vif-plugged-a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:56:01 user nova-compute[73627]: WARNING nova.compute.manager [req-8ff3a45e-7755-41e5-8a6c-c6804345baa1 req-55943616-6ed7-4d16-8afe-68ba6fa29f06 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Received unexpected event network-vif-plugged-a28456a3-e363-4a62-9d69-b4219a1d275b for instance with vm_state building and task_state spawning.
Aug 26 16:56:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068963.5784373, de0d18ed-530c-4c9d-9940-c147b6ac2562 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:56:03 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] VM Resumed (Lifecycle Event)
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:56:03 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Instance spawned successfully.
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:56:03 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693068963.5819547, de0d18ed-530c-4c9d-9940-c147b6ac2562 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:56:03 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] VM Started (Lifecycle Event)
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.compute.manager [req-7c0320a4-1998-4ab4-83ad-f0d138608ec3 req-c7913572-c2e1-4282-b028-9f97bd1bacfe service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Received event network-vif-plugged-a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7c0320a4-1998-4ab4-83ad-f0d138608ec3 req-c7913572-c2e1-4282-b028-9f97bd1bacfe service nova] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7c0320a4-1998-4ab4-83ad-f0d138608ec3 req-c7913572-c2e1-4282-b028-9f97bd1bacfe service nova] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7c0320a4-1998-4ab4-83ad-f0d138608ec3 req-c7913572-c2e1-4282-b028-9f97bd1bacfe service nova] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.compute.manager [req-7c0320a4-1998-4ab4-83ad-f0d138608ec3 req-c7913572-c2e1-4282-b028-9f97bd1bacfe service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] No waiting events found dispatching network-vif-plugged-a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:56:03 user nova-compute[73627]: WARNING nova.compute.manager [req-7c0320a4-1998-4ab4-83ad-f0d138608ec3 req-c7913572-c2e1-4282-b028-9f97bd1bacfe service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Received unexpected event network-vif-plugged-a28456a3-e363-4a62-9d69-b4219a1d275b for instance with vm_state building and task_state spawning.
Aug 26 16:56:03 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:56:03 user nova-compute[73627]: INFO nova.compute.manager [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 26 16:56:03 user nova-compute[73627]: DEBUG nova.compute.manager [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:56:03 user nova-compute[73627]: INFO nova.compute.manager [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Took 6.62 seconds to build instance.
Aug 26 16:56:03 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-13469195-c482-4bf6-955b-5951f7045b57 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.719s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:56:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:56:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:56:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:56:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:56:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:25 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:56:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:56:29 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:56:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:30 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:56:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:56:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:56:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:56:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:56:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:56:34 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:56:34 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid 228134a5-86c8-47bc-a34d-e0aba6b33e08 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:56:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Updating instance_info_cache with network_info: [{"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-228134a5-86c8-47bc-a34d-e0aba6b33e08" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:56:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:56:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:56:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:56:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:56:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:56:36 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:56:36 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:56:36 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:56:36 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8424MB free_disk=25.214839935302734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:56:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:56:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:56:37 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 228134a5-86c8-47bc-a34d-e0aba6b33e08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:56:37 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 466ba946-4678-4c5a-ae53-bfa43b051c41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:56:37 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de0d18ed-530c-4c9d-9940-c147b6ac2562 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:56:37 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:56:37 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:56:37 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:56:37 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:56:37 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:56:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:56:38 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:56:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:56:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:56:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:56:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:56:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:56:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:56:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:56:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:56:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:56:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:56:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:56:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:57:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:57:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:57:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:57:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:57:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:57:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-a7977244-6447-4e84-8ef5-76bd23e2b4db req-f06cf766-20c6-4982-ad34-1dcc38177496 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received event network-changed-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:57:04 user nova-compute[73627]: DEBUG nova.compute.manager [req-a7977244-6447-4e84-8ef5-76bd23e2b4db req-f06cf766-20c6-4982-ad34-1dcc38177496 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Refreshing instance network info cache due to event network-changed-86903036-0d66-48f3-8dc0-005508f65f9e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:57:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7977244-6447-4e84-8ef5-76bd23e2b4db req-f06cf766-20c6-4982-ad34-1dcc38177496 service nova] Acquiring lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:57:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7977244-6447-4e84-8ef5-76bd23e2b4db req-f06cf766-20c6-4982-ad34-1dcc38177496 service nova] Acquired lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:57:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-a7977244-6447-4e84-8ef5-76bd23e2b4db req-f06cf766-20c6-4982-ad34-1dcc38177496 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Refreshing network info cache for port 86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:57:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-a7977244-6447-4e84-8ef5-76bd23e2b4db req-f06cf766-20c6-4982-ad34-1dcc38177496 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updated VIF entry in instance network info cache for port 86903036-0d66-48f3-8dc0-005508f65f9e. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:57:04 user nova-compute[73627]: DEBUG nova.network.neutron [req-a7977244-6447-4e84-8ef5-76bd23e2b4db req-f06cf766-20c6-4982-ad34-1dcc38177496 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updating instance_info_cache with network_info: [{"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:57:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-a7977244-6447-4e84-8ef5-76bd23e2b4db req-f06cf766-20c6-4982-ad34-1dcc38177496 service nova] Releasing lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:57:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "42db2558-1a23-4afb-9b31-c834072856a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "42db2558-1a23-4afb-9b31-c834072856a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 16:57:19 user nova-compute[73627]: INFO nova.compute.claims [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Claim successful on node user
Aug 26 16:57:19 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG nova.network.neutron [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 16:57:19 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 16:57:19 user nova-compute[73627]: DEBUG nova.compute.manager [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 16:57:19 user nova-compute[73627]: INFO nova.virt.block_device [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Booting with volume 3b1ed9f5-1334-4888-9615-c9266178c9ce at /dev/vda
Aug 26 16:57:19 user nova-compute[73627]: DEBUG nova.policy [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c2828f3769d420b9d9caef2e6bc902f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4241157d52c848d49bed0589c2ec725e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG os_brick.utils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[98069845-12cb-4531-bb80-b9aa4fed23d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[062775d4-7654-4847-b11f-b2ab255adf8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b77505-2c7f-48cc-8044-72b31fef8b65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb16190-4c0a-49d6-af3c-cf356f5a7301]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:57:19 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:57:19 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ac22dc-507d-4374-923e-c30a12491bd6]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG os_brick.utils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:57:19 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Updating existing volume attachment record: 1e90fe7f-326d-49dd-b4bb-86eaf281bda2 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:57:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:57:20 user nova-compute[73627]: DEBUG nova.network.neutron [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Successfully created port: 1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG nova.network.neutron [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Successfully updated port: 1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquired lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG nova.network.neutron [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-98407258-4970-4f9e-af99-108a00efdc96 req-cec7e68d-f050-4454-9774-7cd604c41b45 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received event network-changed-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-98407258-4970-4f9e-af99-108a00efdc96 req-cec7e68d-f050-4454-9774-7cd604c41b45 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Refreshing instance network info cache due to event network-changed-1ec3fd27-d489-436f-95fc-61d5bcda180b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-98407258-4970-4f9e-af99-108a00efdc96 req-cec7e68d-f050-4454-9774-7cd604c41b45 service nova] Acquiring lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG nova.network.neutron [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG nova.network.neutron [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Updating instance_info_cache with network_info: [{"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Releasing lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG nova.compute.manager [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Instance network_info: |[{"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-98407258-4970-4f9e-af99-108a00efdc96 req-cec7e68d-f050-4454-9774-7cd604c41b45 service nova] Acquired lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:57:21 user nova-compute[73627]: DEBUG nova.network.neutron [req-98407258-4970-4f9e-af99-108a00efdc96 req-cec7e68d-f050-4454-9774-7cd604c41b45 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Refreshing network info cache for port 1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:57:22 user nova-compute[73627]: DEBUG nova.network.neutron [req-98407258-4970-4f9e-af99-108a00efdc96 req-cec7e68d-f050-4454-9774-7cd604c41b45 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Updated VIF entry in instance network info cache for port 1ec3fd27-d489-436f-95fc-61d5bcda180b. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:57:22 user nova-compute[73627]: DEBUG nova.network.neutron [req-98407258-4970-4f9e-af99-108a00efdc96 req-cec7e68d-f050-4454-9774-7cd604c41b45 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Updating instance_info_cache with network_info: [{"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:57:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-98407258-4970-4f9e-af99-108a00efdc96 req-cec7e68d-f050-4454-9774-7cd604c41b45 service nova] Releasing lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:57:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:27 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:57:28 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.compute.manager [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 16:57:30 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Creating image(s)
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Did not create local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Ensure instance console log exists: /opt/stack/data/nova/instances/42db2558-1a23-4afb-9b31-c834072856a1/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Start _get_guest_xml network_info=[{"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQyzcAJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42db2558-1a23-4afb-9b31-c834072856a1', 'attached_at': '', 'detached_at': '', 'volume_id': '3b1ed9f5-1334-4888-9615-c9266178c9ce', 'serial': '3b1ed9f5-1334-4888-9615-c9266178c9ce'}, 'guest_format': None, 'attachment_id': '1e90fe7f-326d-49dd-b4bb-86eaf281bda2', 'volume_type': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 16:57:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:57:30 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQyzcAJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:57:30 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:57:30 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:57:30 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd90b17-426a-499f-88b1-181bbc2ceef7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:57:30 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3108f324-572a-422e-9594-f1cbd4a2fb6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce] added
Aug 26 16:57:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1c49dd-e606-4d99-88a9-597c93d0941d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3abbc9-f142-4b09-a15a-5871a9ed9e88]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQyzcAJT {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQyzcAJT" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8fc44f-7e6c-4db2-a8c3-18afb13080bd]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gQyzcAJT'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ea9abe-30a4-4efb-af5f-0ce475695556]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10b8b2b-77c8-460a-a077-6618ee4f0df4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:57:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:57:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[46630aee-381d-4db0-b047-83b7d2352e18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce, portal: 172.16.0.220,3260]
Aug 26 16:57:30 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce, portal: 172.16.0.220,3260] successful.
Aug 26 16:57:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[91170963-0d64-41d6-a020-d84d4b5d07e6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9604e712-b1f9-4310-a112-831043d8abfe]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:57:30 user nova-compute[73627]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)
Aug 26 16:57:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:57:30 user nova-compute[73627]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)
Aug 26 16:57:30 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7101c2af-7f92-47dc-afd9-472a2042a0f3]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:57:30 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQyzcAJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23637383233666638', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637383233666638', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-588261291',display_name='tempest-TestVolumeBootPattern-server-588261291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-588261291',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFG7wB0UmOp8pWohUGUbew4A+9iiAIJnhdwGUEPyEdu1HQG05W/Bj3k7KHv07ehiBlxAKsBzl/ZdUB+KCGvVAg+9lfOQY879dDx/zV5sgWDmgodrMTlkSVXktIY1G/3Q==',key_name='tempest-TestVolumeBootPattern-977974239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-rgz5t6w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:57:20Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=42db2558-1a23-4afb-9b31-c834072856a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:d7:88,bridge_name='br-int',has_traffic_filtering=True,id=1ec3fd27-d489-436f-95fc-61d5bcda180b,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec3fd27-d4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG nova.objects.instance [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'pci_devices' on Instance uuid 42db2558-1a23-4afb-9b31-c834072856a1 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 16:57:31 user nova-compute[73627]:   <uuid>42db2558-1a23-4afb-9b31-c834072856a1</uuid>
Aug 26 16:57:31 user nova-compute[73627]:   <name>instance-00000033</name>
Aug 26 16:57:31 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 16:57:31 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 16:57:31 user nova-compute[73627]:   <metadata>
Aug 26 16:57:31 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 16:57:31 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 16:57:31 user nova-compute[73627]:       <nova:name>tempest-TestVolumeBootPattern-server-588261291</nova:name>
Aug 26 16:57:31 user nova-compute[73627]:       <nova:creationTime>2023-08-26 16:57:30</nova:creationTime>
Aug 26 16:57:31 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 16:57:31 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 16:57:31 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 16:57:31 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 16:57:31 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 16:57:31 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 16:57:31 user nova-compute[73627]:       </nova:flavor>
Aug 26 16:57:31 user nova-compute[73627]:       <nova:owner>
Aug 26 16:57:31 user nova-compute[73627]:         <nova:user uuid="1c2828f3769d420b9d9caef2e6bc902f">tempest-TestVolumeBootPattern-1705344746-project-member</nova:user>
Aug 26 16:57:31 user nova-compute[73627]:         <nova:project uuid="4241157d52c848d49bed0589c2ec725e">tempest-TestVolumeBootPattern-1705344746</nova:project>
Aug 26 16:57:31 user nova-compute[73627]:       </nova:owner>
Aug 26 16:57:31 user nova-compute[73627]:       <nova:ports>
Aug 26 16:57:31 user nova-compute[73627]:         <nova:port uuid="1ec3fd27-d489-436f-95fc-61d5bcda180b">
Aug 26 16:57:31 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 16:57:31 user nova-compute[73627]:         </nova:port>
Aug 26 16:57:31 user nova-compute[73627]:       </nova:ports>
Aug 26 16:57:31 user nova-compute[73627]:     </nova:instance>
Aug 26 16:57:31 user nova-compute[73627]:   </metadata>
Aug 26 16:57:31 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 16:57:31 user nova-compute[73627]:     <system>
Aug 26 16:57:31 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 16:57:31 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 16:57:31 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 16:57:31 user nova-compute[73627]:       <entry name="serial">42db2558-1a23-4afb-9b31-c834072856a1</entry>
Aug 26 16:57:31 user nova-compute[73627]:       <entry name="uuid">42db2558-1a23-4afb-9b31-c834072856a1</entry>
Aug 26 16:57:31 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 16:57:31 user nova-compute[73627]:     </system>
Aug 26 16:57:31 user nova-compute[73627]:   </sysinfo>
Aug 26 16:57:31 user nova-compute[73627]:   <os>
Aug 26 16:57:31 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 16:57:31 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 16:57:31 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 16:57:31 user nova-compute[73627]:   </os>
Aug 26 16:57:31 user nova-compute[73627]:   <features>
Aug 26 16:57:31 user nova-compute[73627]:     <acpi/>
Aug 26 16:57:31 user nova-compute[73627]:     <apic/>
Aug 26 16:57:31 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 16:57:31 user nova-compute[73627]:   </features>
Aug 26 16:57:31 user nova-compute[73627]:   <clock offset="utc">
Aug 26 16:57:31 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 16:57:31 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 16:57:31 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 16:57:31 user nova-compute[73627]:   </clock>
Aug 26 16:57:31 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 16:57:31 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 16:57:31 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 16:57:31 user nova-compute[73627]:   </cpu>
Aug 26 16:57:31 user nova-compute[73627]:   <devices>
Aug 26 16:57:31 user nova-compute[73627]:     <disk type="block" device="disk">
Aug 26 16:57:31 user nova-compute[73627]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:57:31 user nova-compute[73627]:       <source dev="/dev/sdc"/>
Aug 26 16:57:31 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 16:57:31 user nova-compute[73627]:       <serial>3b1ed9f5-1334-4888-9615-c9266178c9ce</serial>
Aug 26 16:57:31 user nova-compute[73627]:     </disk>
Aug 26 16:57:31 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 16:57:31 user nova-compute[73627]:       <mac address="fa:16:3e:a5:d7:88"/>
Aug 26 16:57:31 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:57:31 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 16:57:31 user nova-compute[73627]:       <target dev="tap1ec3fd27-d4"/>
Aug 26 16:57:31 user nova-compute[73627]:     </interface>
Aug 26 16:57:31 user nova-compute[73627]:     <serial type="pty">
Aug 26 16:57:31 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/42db2558-1a23-4afb-9b31-c834072856a1/console.log" append="off"/>
Aug 26 16:57:31 user nova-compute[73627]:     </serial>
Aug 26 16:57:31 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 16:57:31 user nova-compute[73627]:     <video>
Aug 26 16:57:31 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 16:57:31 user nova-compute[73627]:     </video>
Aug 26 16:57:31 user nova-compute[73627]:     <rng model="virtio">
Aug 26 16:57:31 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 16:57:31 user nova-compute[73627]:     </rng>
Aug 26 16:57:31 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 16:57:31 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 16:57:31 user nova-compute[73627]:       <stats period="10"/>
Aug 26 16:57:31 user nova-compute[73627]:     </memballoon>
Aug 26 16:57:31 user nova-compute[73627]:   </devices>
Aug 26 16:57:31 user nova-compute[73627]: </domain>
Aug 26 16:57:31 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-588261291',display_name='tempest-TestVolumeBootPattern-server-588261291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-588261291',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFG7wB0UmOp8pWohUGUbew4A+9iiAIJnhdwGUEPyEdu1HQG05W/Bj3k7KHv07ehiBlxAKsBzl/ZdUB+KCGvVAg+9lfOQY879dDx/zV5sgWDmgodrMTlkSVXktIY1G/3Q==',key_name='tempest-TestVolumeBootPattern-977974239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-rgz5t6w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T16:57:20Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=42db2558-1a23-4afb-9b31-c834072856a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:d7:88,bridge_name='br-int',has_traffic_filtering=True,id=1ec3fd27-d489-436f-95fc-61d5bcda180b,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec3fd27-d4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG os_vif [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:d7:88,bridge_name='br-int',has_traffic_filtering=True,id=1ec3fd27-d489-436f-95fc-61d5bcda180b,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec3fd27-d4') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec3fd27-d4, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ec3fd27-d4, col_values=(('external_ids', {'iface-id': '1ec3fd27-d489-436f-95fc-61d5bcda180b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:d7:88', 'vm-uuid': '42db2558-1a23-4afb-9b31-c834072856a1'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:57:32 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:32 user nova-compute[73627]: INFO os_vif [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:d7:88,bridge_name='br-int',has_traffic_filtering=True,id=1ec3fd27-d489-436f-95fc-61d5bcda180b,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec3fd27-d4')
Aug 26 16:57:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:57:32 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] No VIF found with MAC fa:16:3e:a5:d7:88, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:57:32 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:57:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:33 user nova-compute[73627]: DEBUG nova.compute.manager [req-8c97be80-d5e2-4e35-80db-62df640bd1f7 req-29126ce3-2f4b-413b-a9e9-7e9308fc03aa service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received event network-vif-plugged-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:57:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8c97be80-d5e2-4e35-80db-62df640bd1f7 req-29126ce3-2f4b-413b-a9e9-7e9308fc03aa service nova] Acquiring lock "42db2558-1a23-4afb-9b31-c834072856a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:57:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8c97be80-d5e2-4e35-80db-62df640bd1f7 req-29126ce3-2f4b-413b-a9e9-7e9308fc03aa service nova] Lock "42db2558-1a23-4afb-9b31-c834072856a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:57:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8c97be80-d5e2-4e35-80db-62df640bd1f7 req-29126ce3-2f4b-413b-a9e9-7e9308fc03aa service nova] Lock "42db2558-1a23-4afb-9b31-c834072856a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:57:33 user nova-compute[73627]: DEBUG nova.compute.manager [req-8c97be80-d5e2-4e35-80db-62df640bd1f7 req-29126ce3-2f4b-413b-a9e9-7e9308fc03aa service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] No waiting events found dispatching network-vif-plugged-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:57:33 user nova-compute[73627]: WARNING nova.compute.manager [req-8c97be80-d5e2-4e35-80db-62df640bd1f7 req-29126ce3-2f4b-413b-a9e9-7e9308fc03aa service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received unexpected event network-vif-plugged-1ec3fd27-d489-436f-95fc-61d5bcda180b for instance with vm_state building and task_state spawning.
Aug 26 16:57:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693069055.295108, 42db2558-1a23-4afb-9b31-c834072856a1 => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:57:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] VM Resumed (Lifecycle Event)
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 16:57:35 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Instance spawned successfully.
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 16:57:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693069055.2967727, 42db2558-1a23-4afb-9b31-c834072856a1 => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:57:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] VM Started (Lifecycle Event)
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 16:57:35 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 16:57:35 user nova-compute[73627]: INFO nova.compute.manager [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.compute.manager [req-d79e93e9-8b13-48bb-951d-663a3be6a7a9 req-14fc8539-eb14-4ef4-8c1f-8407f2d97ef7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received event network-vif-plugged-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d79e93e9-8b13-48bb-951d-663a3be6a7a9 req-14fc8539-eb14-4ef4-8c1f-8407f2d97ef7 service nova] Acquiring lock "42db2558-1a23-4afb-9b31-c834072856a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d79e93e9-8b13-48bb-951d-663a3be6a7a9 req-14fc8539-eb14-4ef4-8c1f-8407f2d97ef7 service nova] Lock "42db2558-1a23-4afb-9b31-c834072856a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-d79e93e9-8b13-48bb-951d-663a3be6a7a9 req-14fc8539-eb14-4ef4-8c1f-8407f2d97ef7 service nova] Lock "42db2558-1a23-4afb-9b31-c834072856a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:57:35 user nova-compute[73627]: DEBUG nova.compute.manager [req-d79e93e9-8b13-48bb-951d-663a3be6a7a9 req-14fc8539-eb14-4ef4-8c1f-8407f2d97ef7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] No waiting events found dispatching network-vif-plugged-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:57:35 user nova-compute[73627]: WARNING nova.compute.manager [req-d79e93e9-8b13-48bb-951d-663a3be6a7a9 req-14fc8539-eb14-4ef4-8c1f-8407f2d97ef7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received unexpected event network-vif-plugged-1ec3fd27-d489-436f-95fc-61d5bcda180b for instance with vm_state active and task_state None.
Aug 26 16:57:35 user nova-compute[73627]: INFO nova.compute.manager [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Took 16.42 seconds to build instance.
Aug 26 16:57:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-708499bf-fefa-4ad5-829a-93b3e70b6624 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "42db2558-1a23-4afb-9b31-c834072856a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.516s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:57:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:36 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:57:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:57:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:57:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:57:36 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:57:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updating instance_info_cache with network_info: [{"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:57:37 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:38 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:38 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:57:39 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:57:39 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:57:39 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8462MB free_disk=25.212299346923828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 228134a5-86c8-47bc-a34d-e0aba6b33e08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 466ba946-4678-4c5a-ae53-bfa43b051c41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de0d18ed-530c-4c9d-9940-c147b6ac2562 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 42db2558-1a23-4afb-9b31-c834072856a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:57:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:57:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:57:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-818a30f4-e0ee-447e-8716-d42bff2027e8 req-f83de8fc-6479-4039-a313-26d28b6713a4 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Received event network-changed-a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:57:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-818a30f4-e0ee-447e-8716-d42bff2027e8 req-f83de8fc-6479-4039-a313-26d28b6713a4 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Refreshing instance network info cache due to event network-changed-a28456a3-e363-4a62-9d69-b4219a1d275b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:57:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-818a30f4-e0ee-447e-8716-d42bff2027e8 req-f83de8fc-6479-4039-a313-26d28b6713a4 service nova] Acquiring lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:57:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-818a30f4-e0ee-447e-8716-d42bff2027e8 req-f83de8fc-6479-4039-a313-26d28b6713a4 service nova] Acquired lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:57:48 user nova-compute[73627]: DEBUG nova.network.neutron [req-818a30f4-e0ee-447e-8716-d42bff2027e8 req-f83de8fc-6479-4039-a313-26d28b6713a4 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Refreshing network info cache for port a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:57:48 user nova-compute[73627]: DEBUG nova.network.neutron [req-818a30f4-e0ee-447e-8716-d42bff2027e8 req-f83de8fc-6479-4039-a313-26d28b6713a4 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updated VIF entry in instance network info cache for port a28456a3-e363-4a62-9d69-b4219a1d275b. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:57:48 user nova-compute[73627]: DEBUG nova.network.neutron [req-818a30f4-e0ee-447e-8716-d42bff2027e8 req-f83de8fc-6479-4039-a313-26d28b6713a4 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating instance_info_cache with network_info: [{"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:57:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-818a30f4-e0ee-447e-8716-d42bff2027e8 req-f83de8fc-6479-4039-a313-26d28b6713a4 service nova] Releasing lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:57:50 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:57:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:52 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG nova.objects.instance [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:57:53 user nova-compute[73627]: INFO nova.compute.manager [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attaching volume 7a0dff4f-00a4-4907-9cc4-4248425bd131 to /dev/vdb
Aug 26 16:57:53 user nova-compute[73627]: DEBUG os_brick.utils [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d5709b-36e5-4f34-b0d6-7350af41460b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9481ef1-c250-4d33-af9a-d90c6a154bb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0438f53d-e3d0-4ef7-98e1-2e13fdd263e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bbb9ab-962b-4cb5-9488-3966766e1cb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:57:53 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:57:53 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[85db953e-fe8b-4b85-b120-b99bd32e0272]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG os_brick.utils [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:57:53 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating existing volume attachment record: 18a3f908-1106-4534-949c-bd7b27bce5b9 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:57:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:57:57 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:02 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HENjtwOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:58:04 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:58:04 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:58:04 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[43561f96-ac09-4ae9-a719-b8a1bbbe93dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:58:04 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91a86bb-6108-4dbe-8f67-5bc53d565c2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131] added
Aug 26 16:58:04 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0288fe86-21b9-4a82-ae38-0486927855be]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[672589ae-bd21-4768-9f1b-207f0127ac22]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HENjtwOK {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HENjtwOK" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cdf677-9f5e-4a91-8ecd-4cdf17a7fa6b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HENjtwOK'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25166a2-976c-4476-a33e-399ad72a696a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d756700e-6b9e-4b9c-a2d2-2a053d288cc3]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:58:04 user nova-compute[73627]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)
Aug 26 16:58:04 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:58:04 user nova-compute[73627]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)
Aug 26 16:58:04 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaacbb33-4458-488e-a16a-5ac0a2f1cc2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131, portal: 172.16.0.220,3260]
Aug 26 16:58:04 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131, portal: 172.16.0.220,3260] successful.
Aug 26 16:58:04 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f220946f-2540-4c17-81ed-27aa93605b49]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:58:04 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa83371-cd0a-4d0f-8a7f-dc28ff25e352]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:58:05 user nova-compute[73627]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)
Aug 26 16:58:05 user nova-compute[73627]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 (non-flash)
Aug 26 16:58:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:58:05 user nova-compute[73627]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)
Aug 26 16:58:05 user nova-compute[73627]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 (non-flash)
Aug 26 16:58:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6b4a15-bb31-4784-8287-d3dec4415acc]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:58:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HENjtwOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:58:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:58:06 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23037653131653635', 'path': '/dev/sdd'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:58:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037653131653635', 'path': '/dev/sdd'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:58:06 user nova-compute[73627]: DEBUG nova.objects.instance [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:58:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:58:06 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:58:06 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:58:06 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:58:06 user nova-compute[73627]:   <serial>7a0dff4f-00a4-4907-9cc4-4248425bd131</serial>
Aug 26 16:58:06 user nova-compute[73627]: </disk>
Aug 26 16:58:06 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:58:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:58:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:58:06 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No VIF found with MAC fa:16:3e:e7:6b:b0, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:58:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2b090430-1d5c-48ca-9eff-7f85d68030ed tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.470s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "228134a5-86c8-47bc-a34d-e0aba6b33e08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:58:07 user nova-compute[73627]: INFO nova.compute.manager [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Terminating instance
Aug 26 16:58:07 user nova-compute[73627]: DEBUG nova.compute.manager [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-b2259681-e48d-49e2-8fbd-be9fe301d4db req-714f298e-e24c-4a2f-8162-ac24302fedce service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Received event network-vif-unplugged-d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b2259681-e48d-49e2-8fbd-be9fe301d4db req-714f298e-e24c-4a2f-8162-ac24302fedce service nova] Acquiring lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b2259681-e48d-49e2-8fbd-be9fe301d4db req-714f298e-e24c-4a2f-8162-ac24302fedce service nova] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b2259681-e48d-49e2-8fbd-be9fe301d4db req-714f298e-e24c-4a2f-8162-ac24302fedce service nova] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-b2259681-e48d-49e2-8fbd-be9fe301d4db req-714f298e-e24c-4a2f-8162-ac24302fedce service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] No waiting events found dispatching network-vif-unplugged-d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:58:07 user nova-compute[73627]: DEBUG nova.compute.manager [req-b2259681-e48d-49e2-8fbd-be9fe301d4db req-714f298e-e24c-4a2f-8162-ac24302fedce service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Received event network-vif-unplugged-d9444d43-8990-4389-a11c-2fdecd6a1644 for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:58:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:08 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Instance destroyed successfully.
Aug 26 16:58:08 user nova-compute[73627]: DEBUG nova.objects.instance [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lazy-loading 'resources' on Instance uuid 228134a5-86c8-47bc-a34d-e0aba6b33e08 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:58:08 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1640169064',display_name='tempest-ServersNegativeTestJSON-server-1640169064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1640169064',id=44,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:49:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ddffe7ec6b14545bd7f8d741be7c4a2',ramdisk_id='',reservation_id='r-huirv66y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2065687253',owner_user_name='tempest-ServersNegativeTestJSON-2065687253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:49:17Z,user_data=None,user_id='a771feb2513a4866a1209f1abf754e8c',uuid=228134a5-86c8-47bc-a34d-e0aba6b33e08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:58:08 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converting VIF {"id": "d9444d43-8990-4389-a11c-2fdecd6a1644", "address": "fa:16:3e:11:4a:0c", "network": {"id": "2ffc5d9e-57cc-454a-bd9b-9080b493942f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-976268930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ddffe7ec6b14545bd7f8d741be7c4a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9444d43-89", "ovs_interfaceid": "d9444d43-8990-4389-a11c-2fdecd6a1644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:58:08 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:4a:0c,bridge_name='br-int',has_traffic_filtering=True,id=d9444d43-8990-4389-a11c-2fdecd6a1644,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9444d43-89') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:58:08 user nova-compute[73627]: DEBUG os_vif [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:4a:0c,bridge_name='br-int',has_traffic_filtering=True,id=d9444d43-8990-4389-a11c-2fdecd6a1644,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9444d43-89') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:58:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9444d43-89, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:58:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:58:08 user nova-compute[73627]: INFO os_vif [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:4a:0c,bridge_name='br-int',has_traffic_filtering=True,id=d9444d43-8990-4389-a11c-2fdecd6a1644,network=Network(2ffc5d9e-57cc-454a-bd9b-9080b493942f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9444d43-89')
Aug 26 16:58:08 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Deleting instance files /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08_del
Aug 26 16:58:08 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Deletion of /opt/stack/data/nova/instances/228134a5-86c8-47bc-a34d-e0aba6b33e08_del complete
Aug 26 16:58:08 user nova-compute[73627]: INFO nova.compute.manager [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 26 16:58:08 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:58:08 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:58:08 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:58:09 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:58:09 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Took 1.15 seconds to deallocate network for instance.
Aug 26 16:58:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:58:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:58:09 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:58:09 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:58:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:58:09 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Deleted allocations for instance 228134a5-86c8-47bc-a34d-e0aba6b33e08
Aug 26 16:58:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-5e24a093-f448-48c1-bac9-c47faaaca0e2 tempest-ServersNegativeTestJSON-2065687253 tempest-ServersNegativeTestJSON-2065687253-project-member] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.214s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:58:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-0baf0604-27ec-4d7f-a652-8283832d9425 req-5af8e259-7881-4bfc-af51-6091a921787e service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Received event network-vif-plugged-d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:58:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0baf0604-27ec-4d7f-a652-8283832d9425 req-5af8e259-7881-4bfc-af51-6091a921787e service nova] Acquiring lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:58:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0baf0604-27ec-4d7f-a652-8283832d9425 req-5af8e259-7881-4bfc-af51-6091a921787e service nova] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:58:09 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-0baf0604-27ec-4d7f-a652-8283832d9425 req-5af8e259-7881-4bfc-af51-6091a921787e service nova] Lock "228134a5-86c8-47bc-a34d-e0aba6b33e08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:58:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-0baf0604-27ec-4d7f-a652-8283832d9425 req-5af8e259-7881-4bfc-af51-6091a921787e service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] No waiting events found dispatching network-vif-plugged-d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:58:09 user nova-compute[73627]: WARNING nova.compute.manager [req-0baf0604-27ec-4d7f-a652-8283832d9425 req-5af8e259-7881-4bfc-af51-6091a921787e service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Received unexpected event network-vif-plugged-d9444d43-8990-4389-a11c-2fdecd6a1644 for instance with vm_state deleted and task_state None.
Aug 26 16:58:09 user nova-compute[73627]: DEBUG nova.compute.manager [req-0baf0604-27ec-4d7f-a652-8283832d9425 req-5af8e259-7881-4bfc-af51-6091a921787e service nova] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Received event network-vif-deleted-d9444d43-8990-4389-a11c-2fdecd6a1644 {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:58:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:58:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:23 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693069088.236696, 228134a5-86c8-47bc-a34d-e0aba6b33e08 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:58:23 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] VM Stopped (Lifecycle Event)
Aug 26 16:58:23 user nova-compute[73627]: DEBUG nova.compute.manager [None req-56a7ffbf-cbf7-4e45-b32c-1f125388ed1e None None] [instance: 228134a5-86c8-47bc-a34d-e0aba6b33e08] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:58:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:58:28 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:58:29 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:58:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:31 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:58:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:58:36 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:58:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:58:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:58:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:58:36 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:58:37 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating instance_info_cache with network_info: [{"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:58:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:58:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:58:37 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:58:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:58:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:38 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:58:39 user nova-compute[73627]: INFO nova.compute.manager [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Detaching volume 7a0dff4f-00a4-4907-9cc4-4248425bd131
Aug 26 16:58:39 user nova-compute[73627]: INFO nova.virt.block_device [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attempting to driver detach volume 7a0dff4f-00a4-4907-9cc4-4248425bd131 from mountpoint /dev/vdb
Aug 26 16:58:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Attempting to detach device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:58:39 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:58:39 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:58:39 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:58:39 user nova-compute[73627]:   <serial>7a0dff4f-00a4-4907-9cc4-4248425bd131</serial>
Aug 26 16:58:39 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:58:39 user nova-compute[73627]: </disk>
Aug 26 16:58:39 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:58:39 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Successfully detached device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the persistent domain config.
Aug 26 16:58:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:58:39 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:58:39 user nova-compute[73627]:   <source dev="/dev/sdd"/>
Aug 26 16:58:39 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:58:39 user nova-compute[73627]:   <serial>7a0dff4f-00a4-4907-9cc4-4248425bd131</serial>
Aug 26 16:58:39 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:58:39 user nova-compute[73627]: </disk>
Aug 26 16:58:39 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693069119.668067, de0d18ed-530c-4c9d-9940-c147b6ac2562 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:58:39 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Successfully detached device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the live domain config.
Aug 26 16:58:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HENjtwOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:58:39 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c267bddb-cebc-4336-9040-d5c2a0af4b57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc0c16e-74dc-4c89-869d-40bb7a8aa83d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:58:39 user nova-compute[73627]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)
Aug 26 16:58:39 user nova-compute[73627]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 (non-flash)
Aug 26 16:58:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:58:39 user nova-compute[73627]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)
Aug 26 16:58:39 user nova-compute[73627]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 (non-flash)
Aug 26 16:58:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d03e63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131'): ({'sdd'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Removing single pathed devices sdd {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f868b37d-fefa-42e6-aab9-eacfb5f176d4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a2bea2-713b-43d2-9d75-dd8b874a0e33]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Flushing IO for device /dev/sdd {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed47d11f-cb62-426f-bf8a-b45dc6e8232c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.029s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf19ad32-5817-4403-bf0d-24466e1b7308]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] SCSI volumes sdd have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c439bd7e-e7bc-43b1-848c-bcd1631d9a8a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4160b7ce-080f-4334-81a4-3537655a3bc9]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131, portal: 172.16.0.220,3260]
Aug 26 16:58:39 user nova-compute[73627]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131, portal: 172.16.0.220,3260] successful.
Aug 26 16:58:39 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a0dff4f-00a4-4907-9cc4-4248425bd131 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f0df66-5d6f-4f7a-860f-5d4ec275c182]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== disconnect_volume: return (287ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:58:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:58:40 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:58:40 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:58:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8507MB free_disk=25.238235473632812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 466ba946-4678-4c5a-ae53-bfa43b051c41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de0d18ed-530c-4c9d-9940-c147b6ac2562 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 42db2558-1a23-4afb-9b31-c834072856a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG nova.objects.instance [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95f79378-c675-4074-90ba-34e57a42f1b4 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.704s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:58:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:58:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:58:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:58:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Verify base images {{(pid=73627) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73627) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Image id 7c378a38-67f2-4800-b3b2-bf66a493a20b yields fingerprint 76983d27e62eef037daa752af93f1b2028ebaae7 {{(pid=73627) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 16:58:56 user nova-compute[73627]: INFO nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] image 7c378a38-67f2-4800-b3b2-bf66a493a20b at (/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7): checking
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] image 7c378a38-67f2-4800-b3b2-bf66a493a20b at (/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7): image is in use {{(pid=73627) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] de0d18ed-530c-4c9d-9940-c147b6ac2562 is a valid instance name {{(pid=73627) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] de0d18ed-530c-4c9d-9940-c147b6ac2562 has a disk file {{(pid=73627) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de0d18ed-530c-4c9d-9940-c147b6ac2562 is backed by 76983d27e62eef037daa752af93f1b2028ebaae7 {{(pid=73627) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] 42db2558-1a23-4afb-9b31-c834072856a1 is a valid instance name {{(pid=73627) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] 466ba946-4678-4c5a-ae53-bfa43b051c41 is a valid instance name {{(pid=73627) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 16:58:56 user nova-compute[73627]: WARNING nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Unknown base file: /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513
Aug 26 16:58:56 user nova-compute[73627]: WARNING nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Unknown base file: /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343
Aug 26 16:58:56 user nova-compute[73627]: WARNING nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Unknown base file: /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a
Aug 26 16:58:56 user nova-compute[73627]: WARNING nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Unknown base file: /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522
Aug 26 16:58:56 user nova-compute[73627]: WARNING nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Unknown base file: /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e
Aug 26 16:58:56 user nova-compute[73627]: WARNING nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Unknown base file: /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab
Aug 26 16:58:56 user nova-compute[73627]: WARNING nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Unknown base file: /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a
Aug 26 16:58:56 user nova-compute[73627]: WARNING nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Unknown base file: /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171
Aug 26 16:58:56 user nova-compute[73627]: INFO nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Active base files: /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7
Aug 26 16:58:56 user nova-compute[73627]: INFO nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Removable base files: /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513 /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343 /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522 /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171
Aug 26 16:58:56 user nova-compute[73627]: INFO nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/759b806139aa94d76587484ba9b76ef5b1989513
Aug 26 16:58:56 user nova-compute[73627]: INFO nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9f237936a0893760614b870dc4d948d24f7fb343
Aug 26 16:58:56 user nova-compute[73627]: INFO nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/52e8f61129d1166e518576d5644264b9f02f115a
Aug 26 16:58:56 user nova-compute[73627]: INFO nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3340449c97da6e2f1518b4146e3bab7d8938b522
Aug 26 16:58:56 user nova-compute[73627]: INFO nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/765b30e393e30bd65129db9cfab530f0a733684e
Aug 26 16:58:56 user nova-compute[73627]: INFO nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/48d88bdaa9658a6c1dcc614e68b8addd86b5b7ab
Aug 26 16:58:56 user nova-compute[73627]: INFO nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9c32aa9ce60424143bd13dd5a4ceaff5d6d94a9a
Aug 26 16:58:56 user nova-compute[73627]: INFO nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/41b5dc347b4d9362d0844944fe09edfb9c765171
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Verification complete {{(pid=73627) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Verify swap images {{(pid=73627) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 26 16:58:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.imagecache [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Verify ephemeral images {{(pid=73627) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 26 16:58:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:58:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:59:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 16:59:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:59:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 16:59:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-60fd789b-4f70-4b82-8a36-88313f234efe req-af13440f-580c-4aeb-97c7-30c5390ac6d7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received event network-changed-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:59:11 user nova-compute[73627]: DEBUG nova.compute.manager [req-60fd789b-4f70-4b82-8a36-88313f234efe req-af13440f-580c-4aeb-97c7-30c5390ac6d7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Refreshing instance network info cache due to event network-changed-1ec3fd27-d489-436f-95fc-61d5bcda180b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:59:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-60fd789b-4f70-4b82-8a36-88313f234efe req-af13440f-580c-4aeb-97c7-30c5390ac6d7 service nova] Acquiring lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:59:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-60fd789b-4f70-4b82-8a36-88313f234efe req-af13440f-580c-4aeb-97c7-30c5390ac6d7 service nova] Acquired lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:59:11 user nova-compute[73627]: DEBUG nova.network.neutron [req-60fd789b-4f70-4b82-8a36-88313f234efe req-af13440f-580c-4aeb-97c7-30c5390ac6d7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Refreshing network info cache for port 1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-60fd789b-4f70-4b82-8a36-88313f234efe req-af13440f-580c-4aeb-97c7-30c5390ac6d7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Updated VIF entry in instance network info cache for port 1ec3fd27-d489-436f-95fc-61d5bcda180b. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-60fd789b-4f70-4b82-8a36-88313f234efe req-af13440f-580c-4aeb-97c7-30c5390ac6d7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Updating instance_info_cache with network_info: [{"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-60fd789b-4f70-4b82-8a36-88313f234efe req-af13440f-580c-4aeb-97c7-30c5390ac6d7 service nova] Releasing lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-e1443bc6-9407-42cf-b389-b82508583eea req-9c2e415e-7474-4ed5-a076-376a70391de7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received event network-changed-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG nova.compute.manager [req-e1443bc6-9407-42cf-b389-b82508583eea req-9c2e415e-7474-4ed5-a076-376a70391de7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Refreshing instance network info cache due to event network-changed-1ec3fd27-d489-436f-95fc-61d5bcda180b. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e1443bc6-9407-42cf-b389-b82508583eea req-9c2e415e-7474-4ed5-a076-376a70391de7 service nova] Acquiring lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e1443bc6-9407-42cf-b389-b82508583eea req-9c2e415e-7474-4ed5-a076-376a70391de7 service nova] Acquired lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG nova.network.neutron [req-e1443bc6-9407-42cf-b389-b82508583eea req-9c2e415e-7474-4ed5-a076-376a70391de7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Refreshing network info cache for port 1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "42db2558-1a23-4afb-9b31-c834072856a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "42db2558-1a23-4afb-9b31-c834072856a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "42db2558-1a23-4afb-9b31-c834072856a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "42db2558-1a23-4afb-9b31-c834072856a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "42db2558-1a23-4afb-9b31-c834072856a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:12 user nova-compute[73627]: INFO nova.compute.manager [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Terminating instance
Aug 26 16:59:12 user nova-compute[73627]: DEBUG nova.compute.manager [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:12 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG nova.network.neutron [req-e1443bc6-9407-42cf-b389-b82508583eea req-9c2e415e-7474-4ed5-a076-376a70391de7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Updated VIF entry in instance network info cache for port 1ec3fd27-d489-436f-95fc-61d5bcda180b. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG nova.network.neutron [req-e1443bc6-9407-42cf-b389-b82508583eea req-9c2e415e-7474-4ed5-a076-376a70391de7 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Updating instance_info_cache with network_info: [{"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e1443bc6-9407-42cf-b389-b82508583eea req-9c2e415e-7474-4ed5-a076-376a70391de7 service nova] Releasing lock "refresh_cache-42db2558-1a23-4afb-9b31-c834072856a1" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Instance destroyed successfully.
Aug 26 16:59:13 user nova-compute[73627]: DEBUG nova.objects.instance [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'resources' on Instance uuid 42db2558-1a23-4afb-9b31-c834072856a1 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-588261291',display_name='tempest-TestVolumeBootPattern-server-588261291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-588261291',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFG7wB0UmOp8pWohUGUbew4A+9iiAIJnhdwGUEPyEdu1HQG05W/Bj3k7KHv07ehiBlxAKsBzl/ZdUB+KCGvVAg+9lfOQY879dDx/zV5sgWDmgodrMTlkSVXktIY1G/3Q==',key_name='tempest-TestVolumeBootPattern-977974239',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-rgz5t6w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:57:36Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=42db2558-1a23-4afb-9b31-c834072856a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "address": "fa:16:3e:a5:d7:88", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec3fd27-d4", "ovs_interfaceid": "1ec3fd27-d489-436f-95fc-61d5bcda180b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:d7:88,bridge_name='br-int',has_traffic_filtering=True,id=1ec3fd27-d489-436f-95fc-61d5bcda180b,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec3fd27-d4') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_vif [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:d7:88,bridge_name='br-int',has_traffic_filtering=True,id=1ec3fd27-d489-436f-95fc-61d5bcda180b,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec3fd27-d4') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec3fd27-d4, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:59:13 user nova-compute[73627]: INFO os_vif [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:d7:88,bridge_name='br-int',has_traffic_filtering=True,id=1ec3fd27-d489-436f-95fc-61d5bcda180b,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec3fd27-d4')
Aug 26 16:59:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQyzcAJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:59:13 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb8d06a-f908-4063-a486-02b38e755f39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[169094d2-e82b-4a70-8bec-397c949ff52d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:59:13 user nova-compute[73627]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)
Aug 26 16:59:13 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:59:13 user nova-compute[73627]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce (non-flash)
Aug 26 16:59:13 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3f01ea050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fd9708-5a97-4d12-bb83-94ca5aa6a990]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f13107-6aba-4a94-8dc4-5ebeee153048]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0895a65c-23be-4165-a667-dd06f5bcc9ac]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd435cef-8a52-412c-a486-7c6ae3b2e839]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[71075adf-4f20-47d5-89a0-32f3a1dcaafb]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eae4030-8729-4c5b-ad8a-75be07e2c8b4]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce, portal: 172.16.0.220,3260]
Aug 26 16:59:13 user nova-compute[73627]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce, portal: 172.16.0.220,3260] successful.
Aug 26 16:59:13 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1ed9f5-1334-4888-9615-c9266178c9ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f987ca66-2dc9-4545-a378-9fad033f5326]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== disconnect_volume: return (306ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:59:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:59:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Deleting instance files /opt/stack/data/nova/instances/42db2558-1a23-4afb-9b31-c834072856a1_del
Aug 26 16:59:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Deletion of /opt/stack/data/nova/instances/42db2558-1a23-4afb-9b31-c834072856a1_del complete
Aug 26 16:59:14 user nova-compute[73627]: INFO nova.compute.manager [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 26 16:59:14 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:59:14 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Took 0.64 seconds to deallocate network for instance.
Aug 26 16:59:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-b362f5d0-c6ff-41f6-bde5-269b143ac5f1 req-fc316d10-e2ae-4c80-a885-f701df495cda service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received event network-vif-deleted-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received event network-vif-unplugged-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] Acquiring lock "42db2558-1a23-4afb-9b31-c834072856a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] Lock "42db2558-1a23-4afb-9b31-c834072856a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] Lock "42db2558-1a23-4afb-9b31-c834072856a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] No waiting events found dispatching network-vif-unplugged-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received event network-vif-unplugged-1ec3fd27-d489-436f-95fc-61d5bcda180b for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received event network-vif-plugged-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] Acquiring lock "42db2558-1a23-4afb-9b31-c834072856a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] Lock "42db2558-1a23-4afb-9b31-c834072856a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] Lock "42db2558-1a23-4afb-9b31-c834072856a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:14 user nova-compute[73627]: DEBUG nova.compute.manager [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] No waiting events found dispatching network-vif-plugged-1ec3fd27-d489-436f-95fc-61d5bcda180b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 16:59:14 user nova-compute[73627]: WARNING nova.compute.manager [req-8a22aa3a-2310-42b3-9922-facfd1875c0e req-4fafd9cd-fed9-4b6c-9f88-eb5bcb4296e4 service nova] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Received unexpected event network-vif-plugged-1ec3fd27-d489-436f-95fc-61d5bcda180b for instance with vm_state active and task_state deleting.
Aug 26 16:59:15 user nova-compute[73627]: INFO nova.compute.manager [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Took 0.80 seconds to detach 1 volumes for instance.
Aug 26 16:59:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:15 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:59:15 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:59:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:15 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Deleted allocations for instance 42db2558-1a23-4afb-9b31-c834072856a1
Aug 26 16:59:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-a27519d2-2353-4e99-a68f-3b165d68876c tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "42db2558-1a23-4afb-9b31-c834072856a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.093s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:23 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:59:28 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693069153.5962784, 42db2558-1a23-4afb-9b31-c834072856a1 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 16:59:28 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] VM Stopped (Lifecycle Event)
Aug 26 16:59:28 user nova-compute[73627]: DEBUG nova.compute.manager [None req-e7d700c0-20f0-47cb-a2d7-f3795c080017 None None] [instance: 42db2558-1a23-4afb-9b31-c834072856a1] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 16:59:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:30 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:30 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:33 user nova-compute[73627]: INFO nova.compute.manager [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attaching volume 3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 to /dev/vdb
Aug 26 16:59:33 user nova-compute[73627]: DEBUG os_brick.utils [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[409492a6-59b9-40d5-9c74-4f1bdc1ac8a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfeaf3b9-6e1e-4e39-be84-ac57a1690c98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[936a192e-9a5e-4c51-a549-02cfed70c925]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a314a85-258b-42d8-be9b-7fcc107fc269]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 16:59:33 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 16:59:33 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c042790f-0865-48f4-80af-749f857f0d28]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG os_brick.utils [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:59:33 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating existing volume attachment record: 766a8a44-d10b-448f-89c1-31792dbb1ef6 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 16:59:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:36 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:37 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 16:59:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 16:59:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 16:59:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 16:59:37 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 16:59:37 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid 466ba946-4678-4c5a-ae53-bfa43b051c41 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:59:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updating instance_info_cache with network_info: [{"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 16:59:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 16:59:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 16:59:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:39 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 16:59:39 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:39 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 16:59:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73627) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 16:59:39 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:40 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:59:40 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 16:59:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8629MB free_disk=25.236186981201172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance 466ba946-4678-4c5a-ae53-bfa43b051c41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de0d18ed-530c-4c9d-9940-c147b6ac2562 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing inventories for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating ProviderTree inventory for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating inventory in ProviderTree for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing aggregate associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, aggregates: None {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 16:59:40 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing trait associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 16:59:41 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 16:59:41 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 16:59:41 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 16:59:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:42 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:42 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:48 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:59:50 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJGYDrIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:59:51 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:59:51 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:59:51 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 16:59:51 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] There are 0 instances to clean {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[42495534-589b-442a-b48b-4537f6d6f77c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 16:59:51 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5493cbc-0e2a-4a90-9653-f076afb9ffcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305] added
Aug 26 16:59:51 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3927145c-12db-484a-856a-f874173c5611]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9c3e54-5849-4f2c-93e3-b83093c14327]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJGYDrIU {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJGYDrIU" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[43135b4f-8740-4429-a244-44536c2488de]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bJGYDrIU'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48a6d0d-da68-4ae4-9348-1376b98caac2]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e14897-e2a3-4c95-9fdc-08834131c4dd]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:59:51 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:59:51 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf71271-8aa3-4887-83b5-e46144e00525]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305, portal: 172.16.0.220,3260]
Aug 26 16:59:51 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305, portal: 172.16.0.220,3260] successful.
Aug 26 16:59:51 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d817fe-ae06-4717-89c3-57a49686f2ed]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3375d1f-c78f-46e2-b38a-1707dd1d03cb]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:59:51 user nova-compute[73627]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 (non-flash)
Aug 26 16:59:51 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:59:51 user nova-compute[73627]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 (non-flash)
Aug 26 16:59:51 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[de25f4cc-5bf0-423d-9f74-1a4d43f8f21c]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 16:59:51 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJGYDrIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 16:59:52 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:59:52 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26335363864643665', 'path': '/dev/sdc'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:59:52 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335363864643665', 'path': '/dev/sdc'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 16:59:52 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 16:59:53 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:59:53 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:59:53 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:59:53 user nova-compute[73627]:   <serial>3afdfbe7-d89c-4452-9d87-2ef0eaf9b305</serial>
Aug 26 16:59:53 user nova-compute[73627]: </disk>
Aug 26 16:59:53 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid 466ba946-4678-4c5a-ae53-bfa43b051c41 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Triggering sync for uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "466ba946-4678-4c5a-ae53-bfa43b051c41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No VIF found with MAC fa:16:3e:e7:6b:b0, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6874461e-5171-4ab6-80e5-cfac1e4fd572 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.105s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.203s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 16:59:55 user nova-compute[73627]: INFO nova.compute.manager [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Detaching volume 3afdfbe7-d89c-4452-9d87-2ef0eaf9b305
Aug 26 16:59:55 user nova-compute[73627]: INFO nova.virt.block_device [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attempting to driver detach volume 3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 from mountpoint /dev/vdb
Aug 26 16:59:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Attempting to detach device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:59:55 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:59:55 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:59:55 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:59:55 user nova-compute[73627]:   <serial>3afdfbe7-d89c-4452-9d87-2ef0eaf9b305</serial>
Aug 26 16:59:55 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:59:55 user nova-compute[73627]: </disk>
Aug 26 16:59:55 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:59:55 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Successfully detached device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the persistent domain config.
Aug 26 16:59:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 16:59:55 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 16:59:55 user nova-compute[73627]:   <source dev="/dev/sdc"/>
Aug 26 16:59:55 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 16:59:55 user nova-compute[73627]:   <serial>3afdfbe7-d89c-4452-9d87-2ef0eaf9b305</serial>
Aug 26 16:59:55 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 16:59:55 user nova-compute[73627]: </disk>
Aug 26 16:59:55 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693069195.9399767, de0d18ed-530c-4c9d-9940-c147b6ac2562 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 16:59:55 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Successfully detached device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the live domain config.
Aug 26 16:59:55 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJGYDrIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 16:59:55 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 16:59:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac59cdc-adb9-48a4-a28f-a26dde5c37e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:55 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1709fecf-607d-4431-849c-dda24a4f17d0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:59:56 user nova-compute[73627]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 (non-flash)
Aug 26 16:59:56 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 16:59:56 user nova-compute[73627]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 (non-flash)
Aug 26 16:59:56 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3d03d4ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305'): ({'sdc'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Removing single pathed devices sdc {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe3fff7-e37b-4748-9aec-d7eca648fa8f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a3143-9324-43af-a537-ea6d3b7f2ec2]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Flushing IO for device /dev/sdc {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe00e2cc-7d7b-432f-8a18-8366d43f441a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ce321e-b163-4ff1-b005-a9ef73d66e0c]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] SCSI volumes sdc have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e56c211-6732-468b-bd31-67c0b1b582ac]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e31107-9eb8-48af-a643-3b37a640eb31]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305, portal: 172.16.0.220,3260]
Aug 26 16:59:56 user nova-compute[73627]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305, portal: 172.16.0.220,3260] successful.
Aug 26 16:59:56 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afdfbe7-d89c-4452-9d87-2ef0eaf9b305 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c56677-175a-4636-9c75-291346b15dea]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== disconnect_volume: return (306ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 16:59:56 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73627) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 16:59:58 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 16:59:59 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 16:59:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6c8cd805-aa5a-4b19-acb0-a0a5610bc1b8 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.101s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 16:59:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:03 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:00:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:00:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:00:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:00:08 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:13 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:18 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "466ba946-4678-4c5a-ae53-bfa43b051c41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:00:20 user nova-compute[73627]: INFO nova.compute.manager [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Terminating instance
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-cb0354bf-5b03-491c-874b-f88a7cbaf6fb req-e8462498-1f87-43c4-b936-6ea4187d2841 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received event network-changed-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-cb0354bf-5b03-491c-874b-f88a7cbaf6fb req-e8462498-1f87-43c4-b936-6ea4187d2841 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Refreshing instance network info cache due to event network-changed-86903036-0d66-48f3-8dc0-005508f65f9e. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cb0354bf-5b03-491c-874b-f88a7cbaf6fb req-e8462498-1f87-43c4-b936-6ea4187d2841 service nova] Acquiring lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cb0354bf-5b03-491c-874b-f88a7cbaf6fb req-e8462498-1f87-43c4-b936-6ea4187d2841 service nova] Acquired lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-cb0354bf-5b03-491c-874b-f88a7cbaf6fb req-e8462498-1f87-43c4-b936-6ea4187d2841 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Refreshing network info cache for port 86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.compute.manager [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-208c4e76-c1b9-4ae6-a310-a5bdfc55f89a req-9b55821f-7005-4d2e-9fb2-bbec93cddd27 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received event network-vif-unplugged-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-208c4e76-c1b9-4ae6-a310-a5bdfc55f89a req-9b55821f-7005-4d2e-9fb2-bbec93cddd27 service nova] Acquiring lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-208c4e76-c1b9-4ae6-a310-a5bdfc55f89a req-9b55821f-7005-4d2e-9fb2-bbec93cddd27 service nova] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-208c4e76-c1b9-4ae6-a310-a5bdfc55f89a req-9b55821f-7005-4d2e-9fb2-bbec93cddd27 service nova] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-208c4e76-c1b9-4ae6-a310-a5bdfc55f89a req-9b55821f-7005-4d2e-9fb2-bbec93cddd27 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] No waiting events found dispatching network-vif-unplugged-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.compute.manager [req-208c4e76-c1b9-4ae6-a310-a5bdfc55f89a req-9b55821f-7005-4d2e-9fb2-bbec93cddd27 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received event network-vif-unplugged-86903036-0d66-48f3-8dc0-005508f65f9e for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-cb0354bf-5b03-491c-874b-f88a7cbaf6fb req-e8462498-1f87-43c4-b936-6ea4187d2841 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updated VIF entry in instance network info cache for port 86903036-0d66-48f3-8dc0-005508f65f9e. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.network.neutron [req-cb0354bf-5b03-491c-874b-f88a7cbaf6fb req-e8462498-1f87-43c4-b936-6ea4187d2841 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updating instance_info_cache with network_info: [{"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-cb0354bf-5b03-491c-874b-f88a7cbaf6fb req-e8462498-1f87-43c4-b936-6ea4187d2841 service nova] Releasing lock "refresh_cache-466ba946-4678-4c5a-ae53-bfa43b051c41" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:00:20 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Instance destroyed successfully.
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.objects.instance [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lazy-loading 'resources' on Instance uuid 466ba946-4678-4c5a-ae53-bfa43b051c41 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-456233068',display_name='tempest-TestVolumeBootPattern-server-456233068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-456233068',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFG7wB0UmOp8pWohUGUbew4A+9iiAIJnhdwGUEPyEdu1HQG05W/Bj3k7KHv07ehiBlxAKsBzl/ZdUB+KCGvVAg+9lfOQY879dDx/zV5sgWDmgodrMTlkSVXktIY1G/3Q==',key_name='tempest-TestVolumeBootPattern-977974239',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:55:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4241157d52c848d49bed0589c2ec725e',ramdisk_id='',reservation_id='r-en5elix5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1705344746',owner_user_name='tempest-TestVolumeBootPattern-1705344746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:55:28Z,user_data=None,user_id='1c2828f3769d420b9d9caef2e6bc902f',uuid=466ba946-4678-4c5a-ae53-bfa43b051c41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converting VIF {"id": "86903036-0d66-48f3-8dc0-005508f65f9e", "address": "fa:16:3e:f9:11:96", "network": {"id": "8cc483d9-e9dd-439e-9d4e-b4b47a053149", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1890379491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4241157d52c848d49bed0589c2ec725e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86903036-0d", "ovs_interfaceid": "86903036-0d66-48f3-8dc0-005508f65f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:11:96,bridge_name='br-int',has_traffic_filtering=True,id=86903036-0d66-48f3-8dc0-005508f65f9e,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86903036-0d') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_vif [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:11:96,bridge_name='br-int',has_traffic_filtering=True,id=86903036-0d66-48f3-8dc0-005508f65f9e,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86903036-0d') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86903036-0d, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:00:20 user nova-compute[73627]: INFO os_vif [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:11:96,bridge_name='br-int',has_traffic_filtering=True,id=86903036-0d66-48f3-8dc0-005508f65f9e,network=Network(8cc483d9-e9dd-439e-9d4e-b4b47a053149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86903036-0d')
Aug 26 17:00:20 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJRemWqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:00:20 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[36da8fca-ca2c-43a5-a509-ad5948361a6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e08d8d-bf1c-4db0-9aa5-0a54b6cc6513]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 17:00:20 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 (non-flash)
Aug 26 17:00:20 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3ac7517e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2c02a9-ef50-4b06-8d62-cec18576b28a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d58bc8-0c63-417e-b41a-38a62fac1364]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf3a58f-17f5-4b21-829b-7e4756235dc0]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[05760945-04db-48b8-9276-91c23014bd80]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23637393539333931', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b561e9e4', '/dev/disk/by-id/scsi-1SCST_BIOb561e9e4-67959391d981a2e0') {{(pid=84800) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0713b17b-8e6d-4ab7-86e5-fb986c2270d3]: (4, None) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:00:20 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfb87eb-316e-4d38-aaf0-100d0a095c1a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a91f514-3406-4b7c-8535-08516ca2993c]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260]
Aug 26 17:00:21 user nova-compute[73627]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0, portal: 172.16.0.220,3260] successful.
Aug 26 17:00:21 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f33b3b-6cfd-419d-9497-723c95217ad0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7908621d-26d0-4b8c-bd23-05817731c36f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] <== disconnect_volume: return (288ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:00:21 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Deleting instance files /opt/stack/data/nova/instances/466ba946-4678-4c5a-ae53-bfa43b051c41_del
Aug 26 17:00:21 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Deletion of /opt/stack/data/nova/instances/466ba946-4678-4c5a-ae53-bfa43b051c41_del complete
Aug 26 17:00:21 user nova-compute[73627]: INFO nova.compute.manager [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 26 17:00:21 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:00:21 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:00:21 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Took 0.62 seconds to deallocate network for instance.
Aug 26 17:00:21 user nova-compute[73627]: DEBUG nova.compute.manager [req-5ad85984-ce36-4541-a48d-d4aeb4fb4a0b req-224fd1c1-b3fe-4091-afd5-5b40a24e6a44 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received event network-vif-deleted-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:00:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-b34e50a1-54a0-4d56-9830-515ce0f8561c req-4db94810-a197-48a0-9298-767e465ec9e1 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received event network-vif-plugged-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:00:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b34e50a1-54a0-4d56-9830-515ce0f8561c req-4db94810-a197-48a0-9298-767e465ec9e1 service nova] Acquiring lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:00:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b34e50a1-54a0-4d56-9830-515ce0f8561c req-4db94810-a197-48a0-9298-767e465ec9e1 service nova] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:00:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-b34e50a1-54a0-4d56-9830-515ce0f8561c req-4db94810-a197-48a0-9298-767e465ec9e1 service nova] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:00:22 user nova-compute[73627]: DEBUG nova.compute.manager [req-b34e50a1-54a0-4d56-9830-515ce0f8561c req-4db94810-a197-48a0-9298-767e465ec9e1 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] No waiting events found dispatching network-vif-plugged-86903036-0d66-48f3-8dc0-005508f65f9e {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:00:22 user nova-compute[73627]: WARNING nova.compute.manager [req-b34e50a1-54a0-4d56-9830-515ce0f8561c req-4db94810-a197-48a0-9298-767e465ec9e1 service nova] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Received unexpected event network-vif-plugged-86903036-0d66-48f3-8dc0-005508f65f9e for instance with vm_state active and task_state deleting.
Aug 26 17:00:22 user nova-compute[73627]: INFO nova.compute.manager [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Took 0.75 seconds to detach 1 volumes for instance.
Aug 26 17:00:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:00:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:00:22 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:00:22 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:00:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:00:22 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Deleted allocations for instance 466ba946-4678-4c5a-ae53-bfa43b051c41
Aug 26 17:00:22 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-9d27bf0d-f224-4e7d-938f-2c7e4e72bc85 tempest-TestVolumeBootPattern-1705344746 tempest-TestVolumeBootPattern-1705344746-project-member] Lock "466ba946-4678-4c5a-ae53-bfa43b051c41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.836s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:00:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:31 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:00:32 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:00:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:00:35 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693069220.7837021, 466ba946-4678-4c5a-ae53-bfa43b051c41 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:00:35 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] VM Stopped (Lifecycle Event)
Aug 26 17:00:35 user nova-compute[73627]: DEBUG nova.compute.manager [None req-58814e47-1046-4bc2-a57f-15aca6bc3bd2 None None] [instance: 466ba946-4678-4c5a-ae53-bfa43b051c41] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:00:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:00:37 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:00:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:00:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:00:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:00:37 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:00:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating instance_info_cache with network_info: [{"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:00:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:00:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:00:38 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:00:40 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:00:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:00:40 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:00:41 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:00:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:00:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:00:41 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:00:41 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:00:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:41 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:42 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:42 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:00:42 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:00:42 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=25.22573471069336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:00:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:00:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:00:42 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de0d18ed-530c-4c9d-9940-c147b6ac2562 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:00:42 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:00:42 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:00:42 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:00:42 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:00:42 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:00:42 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:00:43 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:00:43 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:00:45 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:00:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:00:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:00:49 user nova-compute[73627]: DEBUG nova.objects.instance [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:00:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:00:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:00:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:00:49 user nova-compute[73627]: INFO nova.compute.manager [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attaching volume 30040483-0f24-456a-938e-c4b795165b76 to /dev/vdb
Aug 26 17:00:49 user nova-compute[73627]: DEBUG os_brick.utils [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:00:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed28586d-5a47-401d-984d-7f9546138a98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b003b6a-eabf-45cb-8197-b344bfd27b8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eb779e-5fda-4d3a-94d3-08a45ea022af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d79ec9-3b37-4892-9cfb-a6384939dcbd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:00:50 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:00:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4687a8-d15a-4e15-924d-0acb874ed905]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG os_brick.utils [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating existing volume attachment record: 99a9f75c-7bcf-45af-942f-c48d340655b8 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:00:50 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:00:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:00:55 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsoxZVST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:01:00 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:01:00 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:01:00 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a0d9c0-20cf-48e4-b91a-6e2f0f1da7ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:01:00 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f544d76-5ccc-4cd6-b181-4ce2c3674004]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76] added
Aug 26 17:01:00 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70d1275-f93d-4d95-a2c7-92e50db2c726]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[3872d8e5-f70d-45d3-b8a8-f6ec5ac9897a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsoxZVST {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsoxZVST" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aad36d5-c533-446d-bd66-ba4e42aff0d3]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BsoxZVST'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b3762-d5fe-4f37-aa2c-e995cff66d93]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e59aad3-b803-4a1a-873d-a530cb0ea82d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:01:00 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:01:00 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:01:00 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 17:01:00 user nova-compute[73627]: 
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc52d90-180a-498e-9fde-ea21bf919653]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76, portal: 172.16.0.220,3260]
Aug 26 17:01:00 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76, portal: 172.16.0.220,3260] successful.
Aug 26 17:01:00 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5048cef9-e598-4ab0-b867-242bb13e7aad]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[71933387-74f0-4baa-8ec4-42d5a1b14df8]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 (non-flash)
Aug 26 17:01:00 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 (non-flash)
Aug 26 17:01:00 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8475045-9be0-450e-bdfd-cefc7a35033a]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:01:00 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:01 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:01:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsoxZVST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:01:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:01:01 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23334353432383238', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:01:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334353432383238', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:01:01 user nova-compute[73627]: DEBUG nova.objects.instance [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:01:01 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:01:01 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:01:01 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 17:01:01 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:01:01 user nova-compute[73627]:   <serial>30040483-0f24-456a-938e-c4b795165b76</serial>
Aug 26 17:01:01 user nova-compute[73627]: </disk>
Aug 26 17:01:01 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:01:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:01:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:01:02 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No VIF found with MAC fa:16:3e:e7:6b:b0, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:01:02 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-2301185b-4521-42e5-a33e-103e30d84199 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.427s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:04 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:04 user nova-compute[73627]: INFO nova.compute.manager [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Detaching volume 30040483-0f24-456a-938e-c4b795165b76
Aug 26 17:01:04 user nova-compute[73627]: INFO nova.virt.block_device [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attempting to driver detach volume 30040483-0f24-456a-938e-c4b795165b76 from mountpoint /dev/vdb
Aug 26 17:01:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Attempting to detach device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:01:04 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:01:04 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:01:04 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 17:01:04 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:01:04 user nova-compute[73627]:   <serial>30040483-0f24-456a-938e-c4b795165b76</serial>
Aug 26 17:01:04 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:01:04 user nova-compute[73627]: </disk>
Aug 26 17:01:04 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:01:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Successfully detached device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the persistent domain config.
Aug 26 17:01:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:01:05 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:01:05 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 17:01:05 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:01:05 user nova-compute[73627]:   <serial>30040483-0f24-456a-938e-c4b795165b76</serial>
Aug 26 17:01:05 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:01:05 user nova-compute[73627]: </disk>
Aug 26 17:01:05 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693069265.4517136, de0d18ed-530c-4c9d-9940-c147b6ac2562 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:01:05 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Successfully detached device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the live domain config.
Aug 26 17:01:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsoxZVST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:01:05 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e81dae4-b6a2-468d-ab4b-1e34f22867e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8087799-17a6-4a77-9413-ef7c23162e61]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 (non-flash)
Aug 26 17:01:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 (non-flash)
Aug 26 17:01:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3ac787d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac66ca4-ea0d-4e03-ad4b-564a530d04b6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a3f197-8b3a-48d5-82ff-1fe071136d96]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fc45cf-326e-4f74-a7dd-37db5aa56c2c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[a964b876-0ed1-4a51-8ab5-5bf3ff7a3d56]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4754dd-d466-43f9-973a-ed13206e06ee]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[702b2cc7-3bc1-4817-823d-b149a2301d81]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76, portal: 172.16.0.220,3260]
Aug 26 17:01:05 user nova-compute[73627]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76, portal: 172.16.0.220,3260] successful.
Aug 26 17:01:05 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30040483-0f24-456a-938e-c4b795165b76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ae7b6b-63bb-48f5-9443-9ebc09f3d00b]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== disconnect_volume: return (268ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:01:05 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:01:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:06 user nova-compute[73627]: DEBUG nova.objects.instance [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:01:06 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-f6a87cfb-1abb-42e1-87fc-6aad3e2dbc2b tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.698s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:10 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:15 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:01:17 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:20 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:22 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:25 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:28 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:30 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:31 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:01:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "b537a03d-5543-450d-852c-a34ce9459efb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Starting instance... {{(pid=73627) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73627) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 17:01:34 user nova-compute[73627]: INFO nova.compute.claims [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Claim successful on node user
Aug 26 17:01:34 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Start building networks asynchronously for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Allocating IP information in the background. {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG nova.network.neutron [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] allocate_for_instance() {{(pid=73627) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 17:01:34 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 17:01:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Start building block device mappings for instance. {{(pid=73627) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG nova.policy [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73b625b1c5a94c7a96b10ec8a530b362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f00868069545c7bbbede77a720c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73627) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG nova.compute.manager [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Start spawning the instance on the hypervisor. {{(pid=73627) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Creating instance directory {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 17:01:34 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Creating image(s)
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "/opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "/opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "/opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "76983d27e62eef037daa752af93f1b2028ebaae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.175s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk 1073741824 {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7,backing_fmt=raw /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk 1073741824" returned: 0 in 0.050s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "76983d27e62eef037daa752af93f1b2028ebaae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:34 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76983d27e62eef037daa752af93f1b2028ebaae7 --force-share --output=json" returned: 0 in 0.171s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk. size=1073741824 {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Successfully created port: e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG nova.virt.disk.api [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Cannot resize image /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk to a smaller size. {{(pid=73627) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Created local disks {{(pid=73627) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Ensure instance console log exists: /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/console.log {{(pid=73627) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Successfully updated port: e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquired lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:01:35 user nova-compute[73627]: DEBUG nova.network.neutron [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Building network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-fd6de96b-62dc-4d66-ae44-179daa66061b req-2def33e0-0462-439b-8c89-6e232a6d270e service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Received event network-changed-e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.compute.manager [req-fd6de96b-62dc-4d66-ae44-179daa66061b req-2def33e0-0462-439b-8c89-6e232a6d270e service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Refreshing instance network info cache due to event network-changed-e2e87ff8-7463-4075-b676-c317842447de. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fd6de96b-62dc-4d66-ae44-179daa66061b req-2def33e0-0462-439b-8c89-6e232a6d270e service nova] Acquiring lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.network.neutron [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Instance cache missing network info. {{(pid=73627) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.network.neutron [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updating instance_info_cache with network_info: [{"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Releasing lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.compute.manager [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Instance network_info: |[{"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73627) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fd6de96b-62dc-4d66-ae44-179daa66061b req-2def33e0-0462-439b-8c89-6e232a6d270e service nova] Acquired lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.network.neutron [req-fd6de96b-62dc-4d66-ae44-179daa66061b req-2def33e0-0462-439b-8c89-6e232a6d270e service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Refreshing network info cache for port e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Start _get_guest_xml network_info=[{"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'image_id': '7c378a38-67f2-4800-b3b2-bf66a493a20b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 17:01:36 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:01:36 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] CPU controller missing on host. {{(pid=73627) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.host [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] CPU controller found on host. {{(pid=73627) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73627) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T16:19:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T16:19:25Z,direct_url=<?>,disk_format='qcow2',id=7c378a38-67f2-4800-b3b2-bf66a493a20b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a7c6cc558f914e288686b7d529eb93a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T16:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Flavor limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Image limits 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Flavor pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Image pref 0:0:0 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Got 1 possible topologies {{(pid=73627) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.hardware [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73627) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-654868703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-654868703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6548687',id=52,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPx3UaptJ4mucnmfNtqayX/o0OmMi9Uu09zKE2CCbH3QK9bFDuEDUmb0Hu0TkDT2cgnYO83G84OrPkRqUvJCnfOlpcsUc1ZHU01TLQrsCVlUuqxg/AnuyVAeMhZDA4gxnQ==',key_name='tempest-keypair-593226607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06f00868069545c7bbbede77a720c337',ramdisk_id='',reservation_id='r-9vjf4hqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-579294924',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73b625b1c5a94c7a96b10ec8a530b362',uuid=b537a03d-5543-450d-852c-a34ce9459efb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73627) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Converting VIF {"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=e2e87ff8-7463-4075-b676-c317842447de,network=Network(3a0de4d5-2498-41e5-bbce-77f1586759dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e87ff8-74') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.objects.instance [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lazy-loading 'pci_devices' on Instance uuid b537a03d-5543-450d-852c-a34ce9459efb {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] End _get_guest_xml xml=<domain type="kvm">
Aug 26 17:01:36 user nova-compute[73627]:   <uuid>b537a03d-5543-450d-852c-a34ce9459efb</uuid>
Aug 26 17:01:36 user nova-compute[73627]:   <name>instance-00000034</name>
Aug 26 17:01:36 user nova-compute[73627]:   <memory>524288</memory>
Aug 26 17:01:36 user nova-compute[73627]:   <vcpu>1</vcpu>
Aug 26 17:01:36 user nova-compute[73627]:   <metadata>
Aug 26 17:01:36 user nova-compute[73627]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 17:01:36 user nova-compute[73627]:       <nova:package version="0.0.0"/>
Aug 26 17:01:36 user nova-compute[73627]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-654868703</nova:name>
Aug 26 17:01:36 user nova-compute[73627]:       <nova:creationTime>2023-08-26 17:01:36</nova:creationTime>
Aug 26 17:01:36 user nova-compute[73627]:       <nova:flavor name="m1.tiny">
Aug 26 17:01:36 user nova-compute[73627]:         <nova:memory>512</nova:memory>
Aug 26 17:01:36 user nova-compute[73627]:         <nova:disk>1</nova:disk>
Aug 26 17:01:36 user nova-compute[73627]:         <nova:swap>0</nova:swap>
Aug 26 17:01:36 user nova-compute[73627]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 17:01:36 user nova-compute[73627]:         <nova:vcpus>1</nova:vcpus>
Aug 26 17:01:36 user nova-compute[73627]:       </nova:flavor>
Aug 26 17:01:36 user nova-compute[73627]:       <nova:owner>
Aug 26 17:01:36 user nova-compute[73627]:         <nova:user uuid="73b625b1c5a94c7a96b10ec8a530b362">tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member</nova:user>
Aug 26 17:01:36 user nova-compute[73627]:         <nova:project uuid="06f00868069545c7bbbede77a720c337">tempest-TestServerVolumeAttachScenarioOldVersion-579294924</nova:project>
Aug 26 17:01:36 user nova-compute[73627]:       </nova:owner>
Aug 26 17:01:36 user nova-compute[73627]:       <nova:root type="image" uuid="7c378a38-67f2-4800-b3b2-bf66a493a20b"/>
Aug 26 17:01:36 user nova-compute[73627]:       <nova:ports>
Aug 26 17:01:36 user nova-compute[73627]:         <nova:port uuid="e2e87ff8-7463-4075-b676-c317842447de">
Aug 26 17:01:36 user nova-compute[73627]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 17:01:36 user nova-compute[73627]:         </nova:port>
Aug 26 17:01:36 user nova-compute[73627]:       </nova:ports>
Aug 26 17:01:36 user nova-compute[73627]:     </nova:instance>
Aug 26 17:01:36 user nova-compute[73627]:   </metadata>
Aug 26 17:01:36 user nova-compute[73627]:   <sysinfo type="smbios">
Aug 26 17:01:36 user nova-compute[73627]:     <system>
Aug 26 17:01:36 user nova-compute[73627]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 17:01:36 user nova-compute[73627]:       <entry name="product">OpenStack Nova</entry>
Aug 26 17:01:36 user nova-compute[73627]:       <entry name="version">0.0.0</entry>
Aug 26 17:01:36 user nova-compute[73627]:       <entry name="serial">b537a03d-5543-450d-852c-a34ce9459efb</entry>
Aug 26 17:01:36 user nova-compute[73627]:       <entry name="uuid">b537a03d-5543-450d-852c-a34ce9459efb</entry>
Aug 26 17:01:36 user nova-compute[73627]:       <entry name="family">Virtual Machine</entry>
Aug 26 17:01:36 user nova-compute[73627]:     </system>
Aug 26 17:01:36 user nova-compute[73627]:   </sysinfo>
Aug 26 17:01:36 user nova-compute[73627]:   <os>
Aug 26 17:01:36 user nova-compute[73627]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 17:01:36 user nova-compute[73627]:     <boot dev="hd"/>
Aug 26 17:01:36 user nova-compute[73627]:     <smbios mode="sysinfo"/>
Aug 26 17:01:36 user nova-compute[73627]:   </os>
Aug 26 17:01:36 user nova-compute[73627]:   <features>
Aug 26 17:01:36 user nova-compute[73627]:     <acpi/>
Aug 26 17:01:36 user nova-compute[73627]:     <apic/>
Aug 26 17:01:36 user nova-compute[73627]:     <vmcoreinfo/>
Aug 26 17:01:36 user nova-compute[73627]:   </features>
Aug 26 17:01:36 user nova-compute[73627]:   <clock offset="utc">
Aug 26 17:01:36 user nova-compute[73627]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 17:01:36 user nova-compute[73627]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 17:01:36 user nova-compute[73627]:     <timer name="hpet" present="no"/>
Aug 26 17:01:36 user nova-compute[73627]:   </clock>
Aug 26 17:01:36 user nova-compute[73627]:   <cpu mode="custom" match="exact">
Aug 26 17:01:36 user nova-compute[73627]:     <model>Nehalem</model>
Aug 26 17:01:36 user nova-compute[73627]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 17:01:36 user nova-compute[73627]:   </cpu>
Aug 26 17:01:36 user nova-compute[73627]:   <devices>
Aug 26 17:01:36 user nova-compute[73627]:     <disk type="file" device="disk">
Aug 26 17:01:36 user nova-compute[73627]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 17:01:36 user nova-compute[73627]:       <source file="/opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk"/>
Aug 26 17:01:36 user nova-compute[73627]:       <target dev="vda" bus="virtio"/>
Aug 26 17:01:36 user nova-compute[73627]:     </disk>
Aug 26 17:01:36 user nova-compute[73627]:     <interface type="ethernet">
Aug 26 17:01:36 user nova-compute[73627]:       <mac address="fa:16:3e:15:53:9f"/>
Aug 26 17:01:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 17:01:36 user nova-compute[73627]:       <mtu size="1442"/>
Aug 26 17:01:36 user nova-compute[73627]:       <target dev="tape2e87ff8-74"/>
Aug 26 17:01:36 user nova-compute[73627]:     </interface>
Aug 26 17:01:36 user nova-compute[73627]:     <serial type="pty">
Aug 26 17:01:36 user nova-compute[73627]:       <log file="/opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/console.log" append="off"/>
Aug 26 17:01:36 user nova-compute[73627]:     </serial>
Aug 26 17:01:36 user nova-compute[73627]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 17:01:36 user nova-compute[73627]:     <video>
Aug 26 17:01:36 user nova-compute[73627]:       <model type="virtio"/>
Aug 26 17:01:36 user nova-compute[73627]:     </video>
Aug 26 17:01:36 user nova-compute[73627]:     <rng model="virtio">
Aug 26 17:01:36 user nova-compute[73627]:       <backend model="random">/dev/urandom</backend>
Aug 26 17:01:36 user nova-compute[73627]:     </rng>
Aug 26 17:01:36 user nova-compute[73627]:     <controller type="usb" index="0" model="none"/>
Aug 26 17:01:36 user nova-compute[73627]:     <memballoon model="virtio">
Aug 26 17:01:36 user nova-compute[73627]:       <stats period="10"/>
Aug 26 17:01:36 user nova-compute[73627]:     </memballoon>
Aug 26 17:01:36 user nova-compute[73627]:   </devices>
Aug 26 17:01:36 user nova-compute[73627]: </domain>
Aug 26 17:01:36 user nova-compute[73627]:  {{(pid=73627) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-654868703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-654868703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6548687',id=52,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPx3UaptJ4mucnmfNtqayX/o0OmMi9Uu09zKE2CCbH3QK9bFDuEDUmb0Hu0TkDT2cgnYO83G84OrPkRqUvJCnfOlpcsUc1ZHU01TLQrsCVlUuqxg/AnuyVAeMhZDA4gxnQ==',key_name='tempest-keypair-593226607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06f00868069545c7bbbede77a720c337',ramdisk_id='',reservation_id='r-9vjf4hqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-579294924',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T17:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73b625b1c5a94c7a96b10ec8a530b362',uuid=b537a03d-5543-450d-852c-a34ce9459efb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Converting VIF {"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=e2e87ff8-7463-4075-b676-c317842447de,network=Network(3a0de4d5-2498-41e5-bbce-77f1586759dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e87ff8-74') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG os_vif [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=e2e87ff8-7463-4075-b676-c317842447de,network=Network(3a0de4d5-2498-41e5-bbce-77f1586759dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e87ff8-74') {{(pid=73627) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2e87ff8-74, may_exist=True, interface_attrs={}) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2e87ff8-74, col_values=(('external_ids', {'iface-id': 'e2e87ff8-7463-4075-b676-c317842447de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:53:9f', 'vm-uuid': 'b537a03d-5543-450d-852c-a34ce9459efb'}),), if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:36 user nova-compute[73627]: INFO os_vif [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=e2e87ff8-7463-4075-b676-c317842447de,network=Network(3a0de4d5-2498-41e5-bbce-77f1586759dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e87ff8-74')
Aug 26 17:01:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:01:36 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] No VIF found with MAC fa:16:3e:15:53:9f, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG nova.network.neutron [req-fd6de96b-62dc-4d66-ae44-179daa66061b req-2def33e0-0462-439b-8c89-6e232a6d270e service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updated VIF entry in instance network info cache for port e2e87ff8-7463-4075-b676-c317842447de. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG nova.network.neutron [req-fd6de96b-62dc-4d66-ae44-179daa66061b req-2def33e0-0462-439b-8c89-6e232a6d270e service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updating instance_info_cache with network_info: [{"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-fd6de96b-62dc-4d66-ae44-179daa66061b req-2def33e0-0462-439b-8c89-6e232a6d270e service nova] Releasing lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Skipping network cache update for instance because it is Building. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:01:37 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:01:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-11c50bc3-f5ea-4abc-a320-1d93bb6ac8e8 req-2eb0a721-a345-4ca1-8105-b23cc6423ce3 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Received event network-vif-plugged-e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:01:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-11c50bc3-f5ea-4abc-a320-1d93bb6ac8e8 req-2eb0a721-a345-4ca1-8105-b23cc6423ce3 service nova] Acquiring lock "b537a03d-5543-450d-852c-a34ce9459efb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-11c50bc3-f5ea-4abc-a320-1d93bb6ac8e8 req-2eb0a721-a345-4ca1-8105-b23cc6423ce3 service nova] Lock "b537a03d-5543-450d-852c-a34ce9459efb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-11c50bc3-f5ea-4abc-a320-1d93bb6ac8e8 req-2eb0a721-a345-4ca1-8105-b23cc6423ce3 service nova] Lock "b537a03d-5543-450d-852c-a34ce9459efb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:38 user nova-compute[73627]: DEBUG nova.compute.manager [req-11c50bc3-f5ea-4abc-a320-1d93bb6ac8e8 req-2eb0a721-a345-4ca1-8105-b23cc6423ce3 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] No waiting events found dispatching network-vif-plugged-e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:01:38 user nova-compute[73627]: WARNING nova.compute.manager [req-11c50bc3-f5ea-4abc-a320-1d93bb6ac8e8 req-2eb0a721-a345-4ca1-8105-b23cc6423ce3 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Received unexpected event network-vif-plugged-e2e87ff8-7463-4075-b676-c317842447de for instance with vm_state building and task_state spawning.
Aug 26 17:01:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating instance_info_cache with network_info: [{"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:01:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:01:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:01:38 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693069299.8872614, b537a03d-5543-450d-852c-a34ce9459efb => Resumed> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:01:39 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] VM Resumed (Lifecycle Event)
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Instance event wait completed in 0 seconds for  {{(pid=73627) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Guest created on hypervisor {{(pid=73627) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 17:01:39 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Instance spawned successfully.
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Found default for hw_cdrom_bus of ide {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Found default for hw_disk_bus of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Found default for hw_input_bus of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Found default for hw_pointer_model of None {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Found default for hw_video_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Found default for hw_vif_model of virtio {{(pid=73627) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 17:01:39 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.virt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Emitting event <LifecycleEvent: 1693069299.8902855, b537a03d-5543-450d-852c-a34ce9459efb => Started> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:01:39 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] VM Started (Lifecycle Event)
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:01:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73627) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 17:01:39 user nova-compute[73627]: INFO nova.compute.manager [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 17:01:40 user nova-compute[73627]: INFO nova.compute.manager [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 26 17:01:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:01:40 user nova-compute[73627]: INFO nova.compute.manager [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Took 5.98 seconds to build instance.
Aug 26 17:01:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-48e57712-50ef-4f4d-9829-2f8ae4689805 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.075s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-e71c8c3d-3c29-4a83-b37a-b1c73a67c4e5 req-7959e852-cc45-4f65-8260-692e66cccd23 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Received event network-vif-plugged-e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:01:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e71c8c3d-3c29-4a83-b37a-b1c73a67c4e5 req-7959e852-cc45-4f65-8260-692e66cccd23 service nova] Acquiring lock "b537a03d-5543-450d-852c-a34ce9459efb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e71c8c3d-3c29-4a83-b37a-b1c73a67c4e5 req-7959e852-cc45-4f65-8260-692e66cccd23 service nova] Lock "b537a03d-5543-450d-852c-a34ce9459efb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:40 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-e71c8c3d-3c29-4a83-b37a-b1c73a67c4e5 req-7959e852-cc45-4f65-8260-692e66cccd23 service nova] Lock "b537a03d-5543-450d-852c-a34ce9459efb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:40 user nova-compute[73627]: DEBUG nova.compute.manager [req-e71c8c3d-3c29-4a83-b37a-b1c73a67c4e5 req-7959e852-cc45-4f65-8260-692e66cccd23 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] No waiting events found dispatching network-vif-plugged-e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:01:40 user nova-compute[73627]: WARNING nova.compute.manager [req-e71c8c3d-3c29-4a83-b37a-b1c73a67c4e5 req-7959e852-cc45-4f65-8260-692e66cccd23 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Received unexpected event network-vif-plugged-e2e87ff8-7463-4075-b676-c317842447de for instance with vm_state active and task_state None.
Aug 26 17:01:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:41 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:01:41 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:01:42 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:01:43 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:01:43 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:01:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:43 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:43 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:01:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:43 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:44 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:44 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:01:44 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:01:44 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8670MB free_disk=25.221416473388672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:01:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:44 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:45 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de0d18ed-530c-4c9d-9940-c147b6ac2562 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:01:45 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b537a03d-5543-450d-852c-a34ce9459efb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:01:45 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:01:45 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:01:45 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:01:45 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:01:45 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:01:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:01:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:01:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:01:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:01:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:01:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:58 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:58 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:01:59 user nova-compute[73627]: INFO nova.compute.manager [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attaching volume 04536159-f8b4-4a70-a1cd-53d9e3e64039 to /dev/vdb
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG os_brick.utils [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f47ded-8281-410a-8892-8b199e3cbc44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca330d4a-1245-4234-9f51-d0a022f40598]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7931e3a4-ad0c-4036-898d-28d9a063bd9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd35f87-8ce9-4fce-85a8-407be1d10bea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:01:59 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:01:59 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d57ee2-901e-4390-9afe-5bdb967f5a2b]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG os_brick.utils [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:01:59 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating existing volume attachment record: e6017b6a-7b52-4d08-a56e-7cca55da2648 {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:02:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:02:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:02:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EUBmnSbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:02:09 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:02:09 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:02:09 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdcaaa0-6c43-40bb-8a90-389eacb4449a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:02:09 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea0f8d0-32cb-403e-96f3-b68ea73b56ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039] added
Aug 26 17:02:09 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[289a3463-a271-4718-8d97-d9d56f430120]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[64298ab3-3282-40ca-a0b7-59dc8cd6ad9c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EUBmnSbP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EUBmnSbP" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2857f31-e600-4cc0-8f1b-6eebc9035794]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EUBmnSbP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee5fc98-0bd0-4907-bd35-87e3331c2cd6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cc5cd6-e801-449e-b739-27cfbac66039]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:02:09 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:02:09 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:02:09 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:02:09 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 17:02:09 user nova-compute[73627]: 
Aug 26 17:02:09 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[719fff3b-fd75-47d0-9668-7318e0855bff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039, portal: 172.16.0.220,3260]
Aug 26 17:02:10 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039, portal: 172.16.0.220,3260] successful.
Aug 26 17:02:10 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e2c061-3bcd-49c5-9cfa-8b1f97c81a4c]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d5351d-1b8e-4316-9f13-b0ff69b657c2]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 (non-flash)
Aug 26 17:02:10 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 (non-flash)
Aug 26 17:02:10 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b22ed6-881f-4cc7-b5d0-98c7d27b06f7]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:02:10 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EUBmnSbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:02:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:02:11 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26136636239376232', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:02:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136636239376232', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:02:11 user nova-compute[73627]: DEBUG nova.objects.instance [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:02:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:02:11 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:02:11 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 17:02:11 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:02:11 user nova-compute[73627]:   <serial>04536159-f8b4-4a70-a1cd-53d9e3e64039</serial>
Aug 26 17:02:11 user nova-compute[73627]: </disk>
Aug 26 17:02:11 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:02:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:02:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:02:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:02:11 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] No VIF found with MAC fa:16:3e:e7:6b:b0, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:02:11 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-4b4f120d-fa31-470f-b5ff-eb9440bb5740 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.511s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:02:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:02:13 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:02:13 user nova-compute[73627]: INFO nova.compute.manager [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Detaching volume 04536159-f8b4-4a70-a1cd-53d9e3e64039
Aug 26 17:02:13 user nova-compute[73627]: INFO nova.virt.block_device [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Attempting to driver detach volume 04536159-f8b4-4a70-a1cd-53d9e3e64039 from mountpoint /dev/vdb
Aug 26 17:02:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Attempting to detach device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:02:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:02:13 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:02:13 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 17:02:13 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:02:13 user nova-compute[73627]:   <serial>04536159-f8b4-4a70-a1cd-53d9e3e64039</serial>
Aug 26 17:02:13 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:02:13 user nova-compute[73627]: </disk>
Aug 26 17:02:13 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:02:13 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Successfully detached device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the persistent domain config.
Aug 26 17:02:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:02:13 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:02:13 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:02:13 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 17:02:13 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:02:13 user nova-compute[73627]:   <serial>04536159-f8b4-4a70-a1cd-53d9e3e64039</serial>
Aug 26 17:02:13 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:02:13 user nova-compute[73627]: </disk>
Aug 26 17:02:13 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693069334.2522047, de0d18ed-530c-4c9d-9940-c147b6ac2562 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:02:14 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Successfully detached device vdb from instance de0d18ed-530c-4c9d-9940-c147b6ac2562 from the live domain config.
Aug 26 17:02:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EUBmnSbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:02:14 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4e9c05-d13d-47f1-8628-b0a0b1cc0b4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9f99eb-2013-46d7-bdbb-081a025acf21]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 (non-flash)
Aug 26 17:02:14 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 (non-flash)
Aug 26 17:02:14 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3ac76f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe2dcc8-8876-4aa5-9d8d-0d133b7e158f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84163df-a9fd-4223-a707-89c2aca7b597]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[950d00bc-bd31-4c8b-9af5-8818ed0e0671]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a61312e-c740-4826-ba82-2e2e63aa4759]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd034ad-a658-4a83-9794-e6b2bbe74ed6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1170079e-d1b9-47df-8b96-27a2a3f32476]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039, portal: 172.16.0.220,3260]
Aug 26 17:02:14 user nova-compute[73627]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039, portal: 172.16.0.220,3260] successful.
Aug 26 17:02:14 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04536159-f8b4-4a70-a1cd-53d9e3e64039 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e54f521-204e-459f-9df9-66a48353124a]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] <== disconnect_volume: return (267ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:02:14 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:02:15 user nova-compute[73627]: DEBUG nova.objects.instance [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'flavor' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:02:15 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-04a35991-b927-4a69-bc08-7bf205487672 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:02:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:02:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:02:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:02:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:02:31 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:02:33 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:02:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:02:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:02:38 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:02:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:02:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 17:02:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:02:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:02:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:02:38 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:02:39 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating instance_info_cache with network_info: [{"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:02:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-de0d18ed-530c-4c9d-9940-c147b6ac2562" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:02:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:02:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:02:41 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:02:43 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:02:43 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:02:43 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:02:45 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:02:45 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:02:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:02:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:02:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:02:45 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:02:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:02:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:02:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:02:46 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:02:46 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:02:46 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=25.19244384765625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:02:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:02:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:02:47 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de0d18ed-530c-4c9d-9940-c147b6ac2562 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:02:47 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b537a03d-5543-450d-852c-a34ce9459efb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:02:47 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:02:47 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:02:47 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:02:47 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:02:47 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:02:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:02:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:02:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:03:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:03:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:03:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:03:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:03:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:03:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:03:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:03:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:03:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:03:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:03:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:03:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:03:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:03:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:03:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:03:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:03:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-46f807b0-51a8-4f0c-a3c5-c4658a53812f req-929ea021-1ce7-449c-be8b-e0df6c989028 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Received event network-changed-e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:03:25 user nova-compute[73627]: DEBUG nova.compute.manager [req-46f807b0-51a8-4f0c-a3c5-c4658a53812f req-929ea021-1ce7-449c-be8b-e0df6c989028 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Refreshing instance network info cache due to event network-changed-e2e87ff8-7463-4075-b676-c317842447de. {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 17:03:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-46f807b0-51a8-4f0c-a3c5-c4658a53812f req-929ea021-1ce7-449c-be8b-e0df6c989028 service nova] Acquiring lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:03:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-46f807b0-51a8-4f0c-a3c5-c4658a53812f req-929ea021-1ce7-449c-be8b-e0df6c989028 service nova] Acquired lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:03:25 user nova-compute[73627]: DEBUG nova.network.neutron [req-46f807b0-51a8-4f0c-a3c5-c4658a53812f req-929ea021-1ce7-449c-be8b-e0df6c989028 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Refreshing network info cache for port e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 17:03:25 user nova-compute[73627]: DEBUG nova.network.neutron [req-46f807b0-51a8-4f0c-a3c5-c4658a53812f req-929ea021-1ce7-449c-be8b-e0df6c989028 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updated VIF entry in instance network info cache for port e2e87ff8-7463-4075-b676-c317842447de. {{(pid=73627) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 17:03:25 user nova-compute[73627]: DEBUG nova.network.neutron [req-46f807b0-51a8-4f0c-a3c5-c4658a53812f req-929ea021-1ce7-449c-be8b-e0df6c989028 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updating instance_info_cache with network_info: [{"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:03:25 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-46f807b0-51a8-4f0c-a3c5-c4658a53812f req-929ea021-1ce7-449c-be8b-e0df6c989028 service nova] Releasing lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:03:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:03:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:03:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "b537a03d-5543-450d-852c-a34ce9459efb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG nova.objects.instance [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lazy-loading 'flavor' on Instance uuid b537a03d-5543-450d-852c-a34ce9459efb {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "b537a03d-5543-450d-852c-a34ce9459efb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:03:35 user nova-compute[73627]: INFO nova.compute.manager [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Attaching volume a9d0deed-9753-4289-927d-7e42ac5a337a to /dev/vdb
Aug 26 17:03:35 user nova-compute[73627]: DEBUG os_brick.utils [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaed5a95-6300-4383-a925-4d510e512cea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4daca0f1e879\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd595d5-9fcb-47f9-9e73-7a04cd830e65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc27a5-74ae-4d46-b48e-74fd67fc2f07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[9078586c-e0ef-4b32-b815-305a18622aa0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Running cmd (subprocess): nvme version {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] 'nvme version' failed. Not Retrying. {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.nvmeof [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] nvme not present on system {{(pid=73627) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 17:03:35 user nova-compute[73627]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 17:03:35 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e586cc-9d42-417f-b878-0704a7181b01]: (4, '') {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73627) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.lightos [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] LIGHTOS: no hostnqn found. {{(pid=73627) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG os_brick.utils [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4daca0f1e879', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:03:35 user nova-compute[73627]: DEBUG nova.virt.block_device [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updating existing volume attachment record: 6d1512b2-a218-420c-b520-e3261a86b73b {{(pid=73627) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 17:03:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:38 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:03:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:03:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:03:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:03:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:03:39 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updating instance_info_cache with network_info: [{"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:03:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:03:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:03:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:41 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:45 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Calling os-brick to attach iSCSI Volume {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcwqlies', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:03:46 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:03:46 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:03:46 user nova-compute[73627]: INFO os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c33fa4f-2a4f-4d91-b8f4-1aa41c3177e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 17:03:46 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --interface default --op new {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4059b5-2b46-4d1a-85e3-9db84ca73e27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a] added\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a] added
Aug 26 17:03:46 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89a2c1b-6610-4eee-9103-d7022c5b7ef6]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4019fe-b4a1-4b31-af8a-eab914f4a8fa]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcwqlies {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcwqlies" returned: 0 in 0.024s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac77033-0e1c-46f4-bc79-afc609333a81]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bcwqlies'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2dcc9f-a116-4bff-940d-683608a85f02]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[6396774b-f664-42c5-af96-5cebfd7afce9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:03:46 user nova-compute[73627]:  {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 17:03:46 user nova-compute[73627]:  {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:03:46 user nova-compute[73627]: WARNING os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 17:03:46 user nova-compute[73627]: 
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --login {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0c9c7b-e43d-4180-b2d5-819a8d188935]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a, portal: 172.16.0.220,3260]
Aug 26 17:03:46 user nova-compute[73627]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a, portal: 172.16.0.220,3260] successful.
Aug 26 17:03:46 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a8da13-e1c6-457e-b8de-b47a3b3ca3e4]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b52dd25-66f1-4ebf-8711-4d2017956725]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a (non-flash)
Aug 26 17:03:46 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a (non-flash)
Aug 26 17:03:46 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Connected to 172.16.0.220:3260 {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73627) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73627) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[4309f01c-ad42-44be-a34e-e6598fb73989]: (4, ('- - 0', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73627) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcwqlies', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73627) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73627) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:46 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:03:46 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:03:46 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8675MB free_disk=25.191177368164062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:03:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance de0d18ed-530c-4c9d-9940-c147b6ac2562 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b537a03d-5543-450d-852c-a34ce9459efb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23234303839666333', 'path': '/dev/sdb'} {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234303839666333', 'path': '/dev/sdb'} {{(pid=73627) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.objects.instance [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lazy-loading 'flavor' on Instance uuid b537a03d-5543-450d-852c-a34ce9459efb {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 17:03:47 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:03:47 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 17:03:47 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:03:47 user nova-compute[73627]:   <serial>a9d0deed-9753-4289-927d-7e42ac5a337a</serial>
Aug 26 17:03:47 user nova-compute[73627]: </disk>
Aug 26 17:03:47 user nova-compute[73627]:  {{(pid=73627) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] No BDM found with device name vda, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73627) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] No VIF found with MAC fa:16:3e:15:53:9f, not building metadata {{(pid=73627) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 17:03:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-405f43c5-5d59-408e-8282-b1563d8c8974 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.388s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "b537a03d-5543-450d-852c-a34ce9459efb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:03:49 user nova-compute[73627]: INFO nova.compute.manager [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Detaching volume a9d0deed-9753-4289-927d-7e42ac5a337a
Aug 26 17:03:49 user nova-compute[73627]: INFO nova.virt.block_device [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Attempting to driver detach volume a9d0deed-9753-4289-927d-7e42ac5a337a from mountpoint /dev/vdb
Aug 26 17:03:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Attempting to detach device vdb from instance b537a03d-5543-450d-852c-a34ce9459efb from the persistent domain config. {{(pid=73627) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:03:49 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:03:49 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 17:03:49 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:03:49 user nova-compute[73627]:   <serial>a9d0deed-9753-4289-927d-7e42ac5a337a</serial>
Aug 26 17:03:49 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:03:49 user nova-compute[73627]: </disk>
Aug 26 17:03:49 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:03:49 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Successfully detached device vdb from instance b537a03d-5543-450d-852c-a34ce9459efb from the persistent domain config.
Aug 26 17:03:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b537a03d-5543-450d-852c-a34ce9459efb from the live domain config. {{(pid=73627) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.guest [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 17:03:49 user nova-compute[73627]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 17:03:49 user nova-compute[73627]:   <source dev="/dev/sdb"/>
Aug 26 17:03:49 user nova-compute[73627]:   <target dev="vdb" bus="virtio"/>
Aug 26 17:03:49 user nova-compute[73627]:   <serial>a9d0deed-9753-4289-927d-7e42ac5a337a</serial>
Aug 26 17:03:49 user nova-compute[73627]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 17:03:49 user nova-compute[73627]: </disk>
Aug 26 17:03:49 user nova-compute[73627]:  {{(pid=73627) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-38a6a431-725a-46a7-ba92-1630018406f9 None None] Received event <DeviceRemovedEvent: 1693069429.7299197, b537a03d-5543-450d-852c-a34ce9459efb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73627) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.driver [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b537a03d-5543-450d-852c-a34ce9459efb {{(pid=73627) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 17:03:49 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Successfully detached device vdb from instance b537a03d-5543-450d-852c-a34ce9459efb from the live domain config.
Aug 26 17:03:49 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] calling os-brick to detach iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe3f7049d20>, {'target_iqns': ['iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcwqlies', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 17:03:49 user nova-compute[73627]: WARNING os_brick.initiator.connectors.base [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a', 0)] {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdaae1e-cf01-4d6a-98ef-59a0db1baf84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5121ddf9-6362-47db-9879-60678b8e8e42]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a (non-flash)\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a (non-flash)
Aug 26 17:03:49 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a (non-flash)
Aug 26 17:03:49 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe3ac76eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a'): ({'sdb'}, set())}) {{(pid=73627) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Removing single pathed devices sdb {{(pid=73627) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee985a4-d0bb-4b09-ab3d-ae49907695b2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b82dec4-b04b-485d-9668-c82d3eea8fcd]: (4, ('ok\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Flushing IO for device /dev/sdb {{(pid=73627) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba61734a-2f78-44d6-8c14-6f105c48ec47]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73627) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.084s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a023e-0805-40fc-9835-c2dfd460b1d6]: (4, ('1', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.linuxscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] SCSI volumes sdb have been removed. {{(pid=73627) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a')] {{(pid=73627) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb139a2-1b70-4a34-990c-1bde0cb80e5f]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:03:49 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --logout {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[24144a0b-23a4-4c3b-a7c5-abe71831800f]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a, portal: 172.16.0.220,3260]
Aug 26 17:03:50 user nova-compute[73627]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a, portal: 172.16.0.220,3260] successful.
Aug 26 17:03:50 user nova-compute[73627]:  stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op delete {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d0deed-9753-4289-927d-7e42ac5a337a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f93fc66-632d-4949-8de2-a375c9f9c25d]: (4, ('', '')) {{(pid=84800) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73627) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.base [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] <== disconnect_volume: return (332ms) None {{(pid=73627) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Disconnected iSCSI Volume {{(pid=73627) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG nova.objects.instance [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lazy-loading 'flavor' on Instance uuid b537a03d-5543-450d-852c-a34ce9459efb {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:03:50 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-ceaf9f2f-83bc-4b6e-931c-8659069e1758 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.704s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:03:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:03:53 user nova-compute[73627]: INFO nova.compute.manager [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Terminating instance
Aug 26 17:03:53 user nova-compute[73627]: DEBUG nova.compute.manager [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-7ded298a-25f0-409c-b831-69d8ae01d7d3 req-aa4f3ed0-ae96-44f0-9e14-c3f74998247f service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Received event network-vif-unplugged-a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ded298a-25f0-409c-b831-69d8ae01d7d3 req-aa4f3ed0-ae96-44f0-9e14-c3f74998247f service nova] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ded298a-25f0-409c-b831-69d8ae01d7d3 req-aa4f3ed0-ae96-44f0-9e14-c3f74998247f service nova] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-7ded298a-25f0-409c-b831-69d8ae01d7d3 req-aa4f3ed0-ae96-44f0-9e14-c3f74998247f service nova] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-7ded298a-25f0-409c-b831-69d8ae01d7d3 req-aa4f3ed0-ae96-44f0-9e14-c3f74998247f service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] No waiting events found dispatching network-vif-unplugged-a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG nova.compute.manager [req-7ded298a-25f0-409c-b831-69d8ae01d7d3 req-aa4f3ed0-ae96-44f0-9e14-c3f74998247f service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Received event network-vif-unplugged-a28456a3-e363-4a62-9d69-b4219a1d275b for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:53 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:54 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Instance destroyed successfully.
Aug 26 17:03:54 user nova-compute[73627]: DEBUG nova.objects.instance [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lazy-loading 'resources' on Instance uuid de0d18ed-530c-4c9d-9940-c147b6ac2562 {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:03:54 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T16:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1845761964',display_name='tempest-SnapshotDataIntegrityTests-server-1845761964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1845761964',id=50,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaJ04hwK6dQQRk56PsrPCTXf6nlCoX6oMUwprrzmQwDHkEgQLkxEUymnsNujpH1uXg7VpTp6B7B+NUYhgLM0JAeRh12eaTZt00Cp6Rp1ORpp8wdcaAV91Ti+ZYUMrVjjw==',key_name='tempest-keypair-2037966096',keypairs=<?>,launch_index=0,launched_at=2023-08-26T16:56:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63e47398f849465a94ca0b16646b7c79',ramdisk_id='',reservation_id='r-elihh9td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-439186932',owner_user_name='tempest-SnapshotDataIntegrityTests-439186932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T16:56:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c756d899bea14660af19edf3c6211e92',uuid=de0d18ed-530c-4c9d-9940-c147b6ac2562,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:03:54 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Converting VIF {"id": "a28456a3-e363-4a62-9d69-b4219a1d275b", "address": "fa:16:3e:e7:6b:b0", "network": {"id": "2883bbbb-728b-43fe-a8a9-3435c029e8a8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-958257730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63e47398f849465a94ca0b16646b7c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa28456a3-e3", "ovs_interfaceid": "a28456a3-e363-4a62-9d69-b4219a1d275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:03:54 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:6b:b0,bridge_name='br-int',has_traffic_filtering=True,id=a28456a3-e363-4a62-9d69-b4219a1d275b,network=Network(2883bbbb-728b-43fe-a8a9-3435c029e8a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28456a3-e3') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:03:54 user nova-compute[73627]: DEBUG os_vif [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:6b:b0,bridge_name='br-int',has_traffic_filtering=True,id=a28456a3-e363-4a62-9d69-b4219a1d275b,network=Network(2883bbbb-728b-43fe-a8a9-3435c029e8a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28456a3-e3') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:03:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa28456a3-e3, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:03:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:54 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:03:54 user nova-compute[73627]: INFO os_vif [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:6b:b0,bridge_name='br-int',has_traffic_filtering=True,id=a28456a3-e363-4a62-9d69-b4219a1d275b,network=Network(2883bbbb-728b-43fe-a8a9-3435c029e8a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa28456a3-e3')
Aug 26 17:03:54 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Deleting instance files /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562_del
Aug 26 17:03:54 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Deletion of /opt/stack/data/nova/instances/de0d18ed-530c-4c9d-9940-c147b6ac2562_del complete
Aug 26 17:03:54 user nova-compute[73627]: INFO nova.compute.manager [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 17:03:54 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:03:54 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:03:54 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:03:54 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:03:54 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Took 0.85 seconds to deallocate network for instance.
Aug 26 17:03:54 user nova-compute[73627]: DEBUG nova.compute.manager [req-06c46577-292b-4d2f-9a44-5411cbbee45a req-9b2a64ba-1727-48ee-b6f3-fd341ef814c2 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Received event network-vif-deleted-a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:03:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:03:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:03:55 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:03:55 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:03:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:03:55 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Deleted allocations for instance de0d18ed-530c-4c9d-9940-c147b6ac2562
Aug 26 17:03:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-95e095ad-0778-49f4-aaf9-484b4810be32 tempest-SnapshotDataIntegrityTests-439186932 tempest-SnapshotDataIntegrityTests-439186932-project-member] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.045s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:03:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-42651a80-975a-449f-9a13-8e5f5d4ded01 req-9ae16bd8-bb34-4ce7-95ee-cfc9b25284c6 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Received event network-vif-plugged-a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:03:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42651a80-975a-449f-9a13-8e5f5d4ded01 req-9ae16bd8-bb34-4ce7-95ee-cfc9b25284c6 service nova] Acquiring lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:03:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42651a80-975a-449f-9a13-8e5f5d4ded01 req-9ae16bd8-bb34-4ce7-95ee-cfc9b25284c6 service nova] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:03:55 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-42651a80-975a-449f-9a13-8e5f5d4ded01 req-9ae16bd8-bb34-4ce7-95ee-cfc9b25284c6 service nova] Lock "de0d18ed-530c-4c9d-9940-c147b6ac2562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:03:55 user nova-compute[73627]: DEBUG nova.compute.manager [req-42651a80-975a-449f-9a13-8e5f5d4ded01 req-9ae16bd8-bb34-4ce7-95ee-cfc9b25284c6 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] No waiting events found dispatching network-vif-plugged-a28456a3-e363-4a62-9d69-b4219a1d275b {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:03:55 user nova-compute[73627]: WARNING nova.compute.manager [req-42651a80-975a-449f-9a13-8e5f5d4ded01 req-9ae16bd8-bb34-4ce7-95ee-cfc9b25284c6 service nova] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Received unexpected event network-vif-plugged-a28456a3-e363-4a62-9d69-b4219a1d275b for instance with vm_state deleted and task_state None.
Aug 26 17:03:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:59 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:03:59 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:04:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:04:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:04:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:04:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:04:04 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:09 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693069433.9992704, de0d18ed-530c-4c9d-9940-c147b6ac2562 => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:04:09 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] VM Stopped (Lifecycle Event)
Aug 26 17:04:09 user nova-compute[73627]: DEBUG nova.compute.manager [None req-8011b3fb-373a-4a7a-8f06-173122a23dd5 None None] [instance: de0d18ed-530c-4c9d-9940-c147b6ac2562] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:04:09 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:14 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:19 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:04:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:04:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:04:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:04:24 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:29 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:04:34 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:04:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:04:36 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:04:38 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:04:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:04:38 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 17:04:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 17:04:38 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquired lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 17:04:38 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Forcefully refreshing network info cache for instance {{(pid=73627) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 17:04:38 user nova-compute[73627]: DEBUG nova.objects.instance [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lazy-loading 'info_cache' on Instance uuid b537a03d-5543-450d-852c-a34ce9459efb {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:04:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:39 user nova-compute[73627]: DEBUG nova.network.neutron [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updating instance_info_cache with network_info: [{"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:04:39 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Releasing lock "refresh_cache-b537a03d-5543-450d-852c-a34ce9459efb" {{(pid=73627) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 17:04:39 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updated the network info_cache for instance {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 17:04:43 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:04:44 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:04:45 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:04:45 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:04:45 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "b537a03d-5543-450d-852c-a34ce9459efb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "b537a03d-5543-450d-852c-a34ce9459efb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:04:46 user nova-compute[73627]: INFO nova.compute.manager [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Terminating instance
Aug 26 17:04:46 user nova-compute[73627]: DEBUG nova.compute.manager [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Start destroying the instance on the hypervisor. {{(pid=73627) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-bd70b035-da97-46bc-a53e-d0a412faa372 req-72e79bc2-0136-460c-86f4-b094b83b064a service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Received event network-vif-unplugged-e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bd70b035-da97-46bc-a53e-d0a412faa372 req-72e79bc2-0136-460c-86f4-b094b83b064a service nova] Acquiring lock "b537a03d-5543-450d-852c-a34ce9459efb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bd70b035-da97-46bc-a53e-d0a412faa372 req-72e79bc2-0136-460c-86f4-b094b83b064a service nova] Lock "b537a03d-5543-450d-852c-a34ce9459efb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-bd70b035-da97-46bc-a53e-d0a412faa372 req-72e79bc2-0136-460c-86f4-b094b83b064a service nova] Lock "b537a03d-5543-450d-852c-a34ce9459efb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-bd70b035-da97-46bc-a53e-d0a412faa372 req-72e79bc2-0136-460c-86f4-b094b83b064a service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] No waiting events found dispatching network-vif-unplugged-e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG nova.compute.manager [req-bd70b035-da97-46bc-a53e-d0a412faa372 req-72e79bc2-0136-460c-86f4-b094b83b064a service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Received event network-vif-unplugged-e2e87ff8-7463-4075-b676-c317842447de for instance with task_state deleting. {{(pid=73627) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 17:04:46 user nova-compute[73627]: INFO nova.virt.libvirt.driver [-] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Instance destroyed successfully.
Aug 26 17:04:46 user nova-compute[73627]: DEBUG nova.objects.instance [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lazy-loading 'resources' on Instance uuid b537a03d-5543-450d-852c-a34ce9459efb {{(pid=73627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG nova.virt.libvirt.vif [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T17:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-654868703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-654868703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6548687',id=52,image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPx3UaptJ4mucnmfNtqayX/o0OmMi9Uu09zKE2CCbH3QK9bFDuEDUmb0Hu0TkDT2cgnYO83G84OrPkRqUvJCnfOlpcsUc1ZHU01TLQrsCVlUuqxg/AnuyVAeMhZDA4gxnQ==',key_name='tempest-keypair-593226607',keypairs=<?>,launch_index=0,launched_at=2023-08-26T17:01:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06f00868069545c7bbbede77a720c337',ramdisk_id='',reservation_id='r-9vjf4hqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c378a38-67f2-4800-b3b2-bf66a493a20b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-579294924',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T17:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73b625b1c5a94c7a96b10ec8a530b362',uuid=b537a03d-5543-450d-852c-a34ce9459efb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Converting VIF {"id": "e2e87ff8-7463-4075-b676-c317842447de", "address": "fa:16:3e:15:53:9f", "network": {"id": "3a0de4d5-2498-41e5-bbce-77f1586759dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1532327418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06f00868069545c7bbbede77a720c337", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e87ff8-74", "ovs_interfaceid": "e2e87ff8-7463-4075-b676-c317842447de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG nova.network.os_vif_util [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=e2e87ff8-7463-4075-b676-c317842447de,network=Network(3a0de4d5-2498-41e5-bbce-77f1586759dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e87ff8-74') {{(pid=73627) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG os_vif [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=e2e87ff8-7463-4075-b676-c317842447de,network=Network(3a0de4d5-2498-41e5-bbce-77f1586759dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e87ff8-74') {{(pid=73627) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2e87ff8-74, bridge=br-int, if_exists=True) {{(pid=73627) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:04:46 user nova-compute[73627]: INFO os_vif [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:53:9f,bridge_name='br-int',has_traffic_filtering=True,id=e2e87ff8-7463-4075-b676-c317842447de,network=Network(3a0de4d5-2498-41e5-bbce-77f1586759dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e87ff8-74')
Aug 26 17:04:46 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Deleting instance files /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb_del
Aug 26 17:04:46 user nova-compute[73627]: INFO nova.virt.libvirt.driver [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Deletion of /opt/stack/data/nova/instances/b537a03d-5543-450d-852c-a34ce9459efb_del complete
Aug 26 17:04:47 user nova-compute[73627]: INFO nova.compute.manager [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 17:04:47 user nova-compute[73627]: DEBUG oslo.service.loopingcall [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73627) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 17:04:47 user nova-compute[73627]: DEBUG nova.compute.manager [-] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Deallocating network for instance {{(pid=73627) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 17:04:47 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: b537a03d-5543-450d-852c-a34ce9459efb] deallocate_for_instance() {{(pid=73627) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 17:04:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:47 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:04:47 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:04:47 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:04:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:04:47 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:04:47 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-d12b69cd-0b70-405d-b65b-38ab633a428c req-b14bac10-cb41-45f0-887a-c3aee3115039 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Received event network-vif-deleted-e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:04:48 user nova-compute[73627]: INFO nova.compute.manager [req-d12b69cd-0b70-405d-b65b-38ab633a428c req-b14bac10-cb41-45f0-887a-c3aee3115039 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Neutron deleted interface e2e87ff8-7463-4075-b676-c317842447de; detaching it from the instance and deleting it from the info cache
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.network.neutron [req-d12b69cd-0b70-405d-b65b-38ab633a428c req-b14bac10-cb41-45f0-887a-c3aee3115039 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:04:48 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:04:48 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=25.245513916015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.network.neutron [-] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Updating instance_info_cache with network_info: [] {{(pid=73627) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 17:04:48 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Took 1.10 seconds to deallocate network for instance.
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-d12b69cd-0b70-405d-b65b-38ab633a428c req-b14bac10-cb41-45f0-887a-c3aee3115039 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Detach interface failed, port_id=e2e87ff8-7463-4075-b676-c317842447de, reason: Instance b537a03d-5543-450d-852c-a34ce9459efb could not be found. {{(pid=73627) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Instance b537a03d-5543-450d-852c-a34ce9459efb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73627) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-8a3c65c0-4da3-4f6f-ac63-8c5f9bcc6e8b req-eabf4049-8fff-40fd-8272-5e826e44e3a1 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Received event network-vif-plugged-e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8a3c65c0-4da3-4f6f-ac63-8c5f9bcc6e8b req-eabf4049-8fff-40fd-8272-5e826e44e3a1 service nova] Acquiring lock "b537a03d-5543-450d-852c-a34ce9459efb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8a3c65c0-4da3-4f6f-ac63-8c5f9bcc6e8b req-eabf4049-8fff-40fd-8272-5e826e44e3a1 service nova] Lock "b537a03d-5543-450d-852c-a34ce9459efb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [req-8a3c65c0-4da3-4f6f-ac63-8c5f9bcc6e8b req-eabf4049-8fff-40fd-8272-5e826e44e3a1 service nova] Lock "b537a03d-5543-450d-852c-a34ce9459efb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.manager [req-8a3c65c0-4da3-4f6f-ac63-8c5f9bcc6e8b req-eabf4049-8fff-40fd-8272-5e826e44e3a1 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] No waiting events found dispatching network-vif-plugged-e2e87ff8-7463-4075-b676-c317842447de {{(pid=73627) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 17:04:48 user nova-compute[73627]: WARNING nova.compute.manager [req-8a3c65c0-4da3-4f6f-ac63-8c5f9bcc6e8b req-eabf4049-8fff-40fd-8272-5e826e44e3a1 service nova] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Received unexpected event network-vif-plugged-e2e87ff8-7463-4075-b676-c317842447de for instance with vm_state deleted and task_state None.
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing inventories for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating ProviderTree inventory for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Updating inventory in ProviderTree for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing aggregate associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, aggregates: None {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Refreshing trait associations for resource provider 8659cd71-d22c-49d8-a078-e0d0f2c22090, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=73627) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.647s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:04:48 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:04:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:04:49 user nova-compute[73627]: INFO nova.scheduler.client.report [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Deleted allocations for instance b537a03d-5543-450d-852c-a34ce9459efb
Aug 26 17:04:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-6a0ec4e6-b91e-4a7a-9c9c-68d98e3c98a8 tempest-TestServerVolumeAttachScenarioOldVersion-579294924 tempest-TestServerVolumeAttachScenarioOldVersion-579294924-project-member] Lock "b537a03d-5543-450d-852c-a34ce9459efb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.984s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:04:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:04:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:05:01 user nova-compute[73627]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693069486.910609, b537a03d-5543-450d-852c-a34ce9459efb => Stopped> {{(pid=73627) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 17:05:01 user nova-compute[73627]: INFO nova.compute.manager [-] [instance: b537a03d-5543-450d-852c-a34ce9459efb] VM Stopped (Lifecycle Event)
Aug 26 17:05:01 user nova-compute[73627]: DEBUG nova.compute.manager [None req-7e5f7ed9-c1be-4b59-846a-04503dae4d0b None None] [instance: b537a03d-5543-450d-852c-a34ce9459efb] Checking state {{(pid=73627) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 17:05:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:05:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:05:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:05:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:05:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:03 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:04 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:04 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 17:05:04 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] There are 0 instances to clean {{(pid=73627) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 17:05:05 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:05 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73627) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 17:05:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:05:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:05:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:05:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:05:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:11 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:05:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:05:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:05:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:05:16 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:21 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:05:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:05:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:05:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:05:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:05:26 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:31 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:05:34 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:35 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:36 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:38 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:39 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:40 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Starting heal instance info cache {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 17:05:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Rebuilding the list of instances to heal {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 17:05:40 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Didn't find any instances for network info cache update. {{(pid=73627) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 17:05:41 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:43 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:45 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:46 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:46 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:46 user nova-compute[73627]: DEBUG nova.compute.manager [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73627) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 17:05:46 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:48 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:48 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:05:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:05:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:05:48 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:05:48 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Auditing locally available compute resources for user (node: user) {{(pid=73627) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 17:05:49 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:05:49 user nova-compute[73627]: WARNING nova.virt.libvirt.driver [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 17:05:49 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Hypervisor/Node resource view: name=user free_ram=9091MB free_disk=25.234638214111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73627) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 17:05:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 17:05:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 17:05:49 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 17:05:49 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73627) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 17:05:49 user nova-compute[73627]: DEBUG nova.compute.provider_tree [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed in ProviderTree for provider: 8659cd71-d22c-49d8-a078-e0d0f2c22090 {{(pid=73627) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 17:05:49 user nova-compute[73627]: DEBUG nova.scheduler.client.report [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Inventory has not changed for provider 8659cd71-d22c-49d8-a078-e0d0f2c22090 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73627) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 17:05:49 user nova-compute[73627]: DEBUG nova.compute.resource_tracker [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Compute_service record updated for user:user {{(pid=73627) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 17:05:49 user nova-compute[73627]: DEBUG oslo_concurrency.lockutils [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=73627) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 17:05:51 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:05:56 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:06:01 user nova-compute[73627]: DEBUG oslo_service.periodic_task [None req-456bed0a-d8e2-4a67-822a-c6feccbea76c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73627) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 17:06:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:06:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 17:06:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73627) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 17:06:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:06:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73627) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 17:06:01 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 17:06:06 user nova-compute[73627]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73627) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}